Rarity of Events

Code for the Rarity of Events method that rewards the agent based on the temporal rarity of events. Pre-trained models are found in the models directory.

Videos

Packages to install

• pytorch
• scipy
• sdl2
• vizdoom
• pickle

Training the agent

# A2C baseline
python main.py --num-processes 16 --config-path scenarios/deathmatch.cfg --num-frames 75000000 --no-vis

# A2C+RoE
python main.py --num-processes 16 --config-path scenarios/deathmatch.cfg --num-frames 75000000 --no-vis --roe

# A2C+RoE+QD
python main.py --num-processes 16 --config-path scenarios/deathmatch.cfg --num-frames 75000000 --no-vis --roe --qd --agent-id 1
python main.py --num-processes 16 --config-path scenarios/deathmatch.cfg --num-frames 75000000 --no-vis --roe --qd --agent-id 2

Running the agent

# A2C baseline
python enjoy.py --config-path scenario/deatmatch.cfg

# A2C+RoE
python enjoy.py --config-path scenario/deatmatch.cfg --roe

Acknowledgements

This repository is based on https://github.com/openai/baselines and https://github.com/p-kar/a2c-acktr-vizdoom.