Playing Atari Games with Deep Reinforcement Learning and Human Checkpoint Replay
This paper introduces a novel method for learning how to play the most difficult Atari 2600 games from the Arcade Learning Environment using deep reinforcement learning. The proposed method, human checkpoint replay, consists in using checkpoints sampled from human gameplay as starting points for the learning process. This is meant to compensate for the difficulties of current exploration strategies, such as epsilon-greedy, to find successful control policies in games with sparse rewards. Like other deep reinforcement learning architectures, our model uses a convolutional neural network that receives only raw pixel inputs to estimate the state value function. We tested our method on Montezuma's Revenge and Private Eye, two of the most challenging games from the Atari platform. The results we obtained show a substantial improvement compared to previous learning approaches, as well as over a random player. We also propose a method for training deep reinforcement learning agents using human gameplay experience, which we call human experience replay.
Code (1)
Tasks
Atari GamesDeep Reinforcement LearningMontezuma's Revengereinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Playing Atari with Deep Reinforcement Learning
We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a varia…
Atari GamesDeep Reinforcement LearningMulti-Goal Reinforcement LearningQ-Learning+2On Multi-Agent Learning in Team Sports Games
In recent years, reinforcement learning has been successful in solving video games from Atari to Star Craft II. However, the end-to-end model-free reinforcement learning (RL) is not sample efficient and requires a signif…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Learning To Play Atari Games Using Dueling Q-Learning and Hebbian Plasticity
In this work, an advanced deep reinforcement learning architecture is used to train neural network agents playing atari games. Given only the raw game pixels, action space, and reward information, the system can train ag…
Atari GamesDeep Reinforcement LearningLifelong learningQ-LearningPlaying Atari Ball Games with Hierarchical Reinforcement Learning
Human beings are particularly good at reasoning and inference from just a few examples. When facing new tasks, humans will leverage knowledge and skills learned before, and quickly integrate them with the new task. In ad…
Atari GamesHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+1Virtual Augmented Reality for Atari Reinforcement Learning
Reinforcement Learning (RL) has achieved significant milestones in the gaming domain, most notably Google DeepMind's AlphaGo defeating human Go champion Ken Jie. This victory was also made possible through the Atari Lear…
Image Segmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1