Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning

2014-12-01 · NeurIPS 2014 12 · Xiaoxiao Guo, Satinder Singh, Honglak Lee, Richard L. Lewis, Xiaoshi Wang

The combination of modern Reinforcement Learning and Deep Learning approaches holds the promise of making significant progress on challenging applications requiring both rich perception and policy-selection. The Arcade Learning Environment (ALE) provides a set of Atari games that represent a useful benchmark set of such applications. A recent breakthrough in combining model-free reinforcement learning with deep learning, called DQN, achieves the best real-time agents thus far. Planning-based approaches achieve far higher scores than the best model-free approaches, but they exploit information that is not available to human players, and they are orders of magnitude slower than needed for real-time play. Our main goal in this work is to build a better real-time Atari game playing agent than DQN. The central idea is to use the slow planning-based agents to provide training data for a deep-learning architecture capable of real-time play. We proposed new agents based on this idea and show that they outperform DQN.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Atari GamesDeep Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

CrowdPlay: Crowdsourcing human demonstration data for offline learning in Atari games

2021-09-29 · ICLR 2022 4 · Matthias Gerstgrasser, Rakshit Trivedi, David C. Parkes

Human demonstrations of video game play can serve as vital surrogate representations of real-world behaviors, access to which would facilitate rapid progress in several complex learning settings (e.g. behavior classifica…

Atari Games Decision Making Imitation Learning Offline RL+2

An Optimistic Perspective on Offline Reinforcement Learning

2019-07-10 · Rishabh Agarwal, Dale Schuurmans, Mohammad Norouzi

Off-policy reinforcement learning (RL) using a fixed offline dataset of logged interactions is an important consideration in real world applications. This paper studies offline RL using the DQN replay dataset comprising …

Atari Games Diversity DQN Replay Dataset Offline RL+4

An Optimistic Perspective on Offline Deep Reinforcement Learning

2020-01-01 · ICML 2020 1 · Rishabh Agarwal, Dale Schuurmans, Mohammad Norouzi

Atari Games Deep Reinforcement Learning Diversity DQN Replay Dataset+5

Virtual Augmented Reality for Atari Reinforcement Learning

2023-10-12 · Christian A. Schiller

Reinforcement Learning (RL) has achieved significant milestones in the gaming domain, most notably Google DeepMind's AlphaGo defeating human Go champion Ken Jie. This victory was also made possible through the Atari Lear…

Image Segmentation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Enhancing Two-Player Performance Through Single-Player Knowledge Transfer: An Empirical Study on Atari 2600 Games

2024-10-22 · Kimiya Saadat, Richard Zhao

Playing two-player games using reinforcement learning and self-play can be challenging due to the complexity of two-player environments and the possible instability in the training process. We propose that a reinforcemen…

Atari Games reinforcement-learning Reinforcement Learning Transfer Learning