Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPU

2016-11-18 · Mohammad Babaeizadeh, Iuri Frosio, Stephen Tyree, Jason Clemons, Jan Kautz

We introduce a hybrid CPU/GPU version of the Asynchronous Advantage Actor-Critic (A3C) algorithm, currently the state-of-the-art method in reinforcement learning for various gaming tasks. We analyze its computational traits and concentrate on aspects critical to leveraging the GPU's computational power. We introduce a system of queues and a dynamic scheduling strategy, potentially helpful for other asynchronous algorithms as well. Our hybrid CPU/GPU version of A3C, based on TensorFlow, achieves a significant speed up compared to a CPU implementation; we make it publicly available to other researchers at https://github.com/NVlabs/GA3C .

📄 PDF Abstract BibTeX arXiv:1611.06256

Code (3)

NVlabs/GA3C 공식 구현 tf

Sheepsody/Batched-Impala-PyTorch pytorch

nicoladainese96/SC2-RL pytorch

Tasks

CPUGPUreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

A3C A3C, Asynchronous Advantage Actor Critic, is a policy gradient algorithm in reinforcement learning that maintains a policy $\pi\left(a\_{t}\mid{s}\_{t}; \theta\right)$ and…

Playing Flappy Bird via Asynchronous Advantage Actor Critic Algorithm

2019-07-06 · Elit Cenk Alp, Mehmet Serdar Guzel

Flappy Bird, which has a very high popularity, has been trained in many algorithms. Some of these studies were trained from raw pixel values of game and some from specific attributes. In this study, the model was trained…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Asynchronous Advantage Actor-Critic Agent for Starcraft II

2018-07-22 · Basel Alghanem, Keerthana P G

Deep reinforcement learning, and especially the Asynchronous Advantage Actor-Critic algorithm, has been successfully used to achieve super-human performance in a variety of video games. Starcraft II is a new challenge fo…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+3

Atari games and Intel processors

2017-05-19 · Robert Adamski, Tomasz Grel, Maciej Klimek, Henryk Michalewski

The asynchronous nature of the state-of-the-art reinforcement learning algorithms such as the Asynchronous Advantage Actor-Critic algorithm, makes them exceptionally suitable for CPU computations. However, given the fact…

Atari Games BIG-bench Machine Learning CPU Deep Reinforcement Learning+4

ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantages

2023-06-02 · Andrew Jesson, Chris Lu, Gunshi Gupta, Nicolas Beltran-Velez 외

This paper proposes a step toward approximate Bayesian inference in on-policy actor-critic deep reinforcement learning. It is implemented through three changes to the Asynchronous Advantage Actor-Critic (A3C) algorithm: …

Bayesian Inference continuous-control Continuous Control Deep Reinforcement Learning+4

Asynchronous training of quantum reinforcement learning

2023-01-12 · Samuel Yen-Chi Chen

The development of quantum machine learning (QML) has received a lot of interest recently thanks to developments in both quantum computing (QC) and machine learning (ML). One of the ML paradigms that can be utilized to a…

Decision Making Quantum Machine Learning reinforcement-learning Reinforcement Learning+2