Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
Theo Jaunet committed Jul 31, 2019
1 parent ba0ac3b commit ff52057
Show file tree
Hide file tree
Showing 3 changed files with 10 additions and 11 deletions.
4 changes: 2 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,8 @@
</div>
<div class="row" style="margin-top: 15px">
<div class="five columns" style="position: relative">
<h5> What if we Reduced the Memory of an Artificial Doom Player?</h5>
<p style="max-height: 100px;">We trained an artificial Doom player <img src="assets/agent.png" class="arrow-icon" height="57px"> using Deep Reinforcement learning.
<h5> What if we Reduce the Memory of an Artificial Doom Player?</h5>
<p style="max-height: 100px;">We built Doom player AI <img src="assets/agent.png" class="arrow-icon" height="57px"> using Deep Reinforcement learning.
While playing, it builds and updates an inner representation (memory) of the game, its environment.
Reducing this memory could help the player learning to complete its task and thus lower both its training time and energy consumption.<br>

Expand Down
6 changes: 3 additions & 3 deletions js/drawVector.js
Original file line number Diff line number Diff line change
Expand Up @@ -244,7 +244,7 @@ function link_model(svg, data) {
.attr('y2', tool[2] - 99)
.attr('stroke', '#555555')
.attr('stroke-dasharray', "4,2")
.attr('stroke-width', '3');
.attr('stroke-width', '1');


svg.append('line')
Expand All @@ -253,8 +253,8 @@ function link_model(svg, data) {
.attr('y1', 608)
.attr('y2', tool[2] - 60)
.attr('stroke', '#555555')
.attr('stroke-dasharray', "4,2")
.attr('stroke-width', '3');
.attr('stroke-dasharray', "3,1")
.attr('stroke-width', '1');
}


Expand Down
11 changes: 5 additions & 6 deletions js/stage.js
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ let stages_txt = [
'<br>',

'A naive approach is to randomly remove memory elements regardless of their activation. In this scenario here, they each have 1 chance out of 2 to be erased. ' +
'We generated 3 different random memory reductions: <a onclick="meta_switch(0)">Random #1</a>, <a onclick="meta_switch(3)">Random #2</a> and <a onclick="meta_switch(10)">Random #3</a>.' +
'We generated 3 different random memory reductions.' +
'<br><br>' +
'In <a onclick="meta_switch(0)">Random #1</a>, the agent only has 31% of its memory. In the resulting trajectory, it gathered the soul-sphere before gathering the health pack which ended the game (fail). ' +
'<br><br>' +
Expand All @@ -33,9 +33,8 @@ let stages_txt = [
'and that reducing the memory while preserving its performances is possible. ',


'If some memory elements are essential, are they among the <a onclick="meta_switch(0)">top 50% activated?</a><a onclick="meta_switch(1)"> The top 25% activated? </a> ' +
'Or the ' +
'<a onclick="meta_switch(2)">top 50% changing?</a>, <a onclick="meta_switch(3)">top 25%?</a> ' +
'If some memory elements are essential, are they among the top activated elements? ' +
'Or perhaps, the top changing ones?' +
'<br><br>' +
'Among the top activated elements we can observe that <a onclick="meta_switch(0)"> with 50% memory </a>' +
', the agent gathered the green armor, but failed to gather the red armor and turned left instead.' +
Expand Down Expand Up @@ -72,9 +71,9 @@ let stages_txt = [
'same time because each combination is pre-generated and therefore, the complete set of memory reduction is not computable. <br><br> ' +
'The reduction of both <a onmouseover="highelems( [10, 23])" onmouseout="resetelems()" onclick="meta_change(\'nDIY/red10_23.json\', [10,23])"> elements 10 and 23 </a> ' +
'is enough to make the agent move turn left after gathering the red armor healh pack. ' +
'In addition; changing <a onmouseover="highelems( [10])" onmouseout="resetelems()"> element 10</a> for <a onmouseover="highelems([5])" onmouseout="resetelems()"> element 5</a>, makes the agent <a onclick="meta_change(\'nDIY/red5_23.json\', [10,23])"> avoid the green armor</a>' +
'In addition; changing <a onmouseover="highelems( [10])" onmouseout="resetelems()"> element 10</a> for <a onmouseover="highelems([5])" onmouseout="resetelems()"> element 5</a>, makes the agent <a onclick="meta_change(\'nDIY/red5_23.json\', [10,23])"> avoid the green armor</a>. ' +
'This indicates that those elements are essential for the agent to decide. ' +
'However, removing only one result on the agent having the same trajectory as when it used its full memory.'];
'<br><br> The possibility to remove up to 2 memory elements provides more than <i>580</i> reductions possible. If you found any interesting reductions, or have any suggestions to improve this tool, please feel free to visit our <a href="https://github.com/Theo-Jaunet/MemoryReduction">github</a>. '];


function update_stage(nb) {
Expand Down

0 comments on commit ff52057

Please sign in to comment.