paper-with-me

Papers

Asynchronous Methods for Deep Reinforcement Learning

2016-02-04 · Volodymyr Mnih, Adrià Puigdomènech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, Koray Kavukcuoglu

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard reinforcement learning algorithms and show that parallel actor-learners have a stabilizing effect on training allowing all four methods to successfully train neural network controllers. The best performing method, an asynchronous variant of actor-critic, surpasses the current state-of-the-art on the Atari domain while training for half the time on a single multi-core CPU instead of a GPU. Furthermore, we show that asynchronous actor-critic succeeds on a wide variety of continuous motor control problems as well as on a new task of navigating random 3D mazes using a visual input.

📄 PDF Abstract BibTeX arXiv:1602.01783

Code (70)

4rChon/NL-FuN tf
AI-RG/rl-experiments tf
DLR-RM/stable-baselines3 pytorch
InSpaceAI/RL-Zoo tf
JulT1/RL_SS19 tf
Jzar/Space-Invaders-DQN tf
Kaixhin/ACER pytorch
Kaixhin/NoisyNet-A3C pytorch
Khrylx/PyTorch-RL pytorch
MatheusMRFM/A3C-LSTM-with-Tensorflow tf
N0r9st/a2c-jax jax
Nasdin/ReinforcementLearning-AtariGame pytorch
NervanaSystems/coach tf
PaulCharnay/Projet_AIF
Remtasya/DDPG-Actor-Critic-Reinforcement-Learning-Reacher-Environment pytorch
Sheepsody/Batched-Impala-PyTorch pytorch
ShibiHe/Q-Optimality-Tightening
Zartris/TD3_continuous_control pytorch
aabbeell/reinforcementLearning.a2c.gym
alexmlamb/blocks_rl_gru_setup pytorch
amanda-lambda/drl-experiments pytorch
amanda-lambda/hack-flappy-bird-drl pytorch
amaudruz/RL_openaigym pytorch
arnomoonens/yarll tf
avillemin/Minecraft-AI pytorch
bentrevett/pytorch-rl pytorch
bkhmsi/meta-rl-harlow pytorch
braemt/attentive-multi-task-deep-reinforcement-learning tf
brett-daley/fast-dqn tf
cdesilv1/sc2_ai_cdes tf
chainer/chainerrl pytorch
danielpolimac/Ispit_Inteligentni_Agenti
deepsense-ai/Distributed-BA3C tf
dickreuter/neuron_poker
dsinghnegi/atari_RL_agent pytorch
grananqvist/reinforcement-learning-super-mario-A3C tf
gungui98/deeprl-a3c-ai2thor tf
hill-a/stable-baselines tf
hulanwin/A3C-DRL tf
ikostrikov/pytorch-a3c pytorch
ikostrikov/pytorch-rl pytorch
joshiatul/game_playing
khanhptnk/bandit-nmt pytorch
lcswillems/torch-ac pytorch
liuyuezhang/pyrl pytorch
marload/DeepRL-TensorFlow2 tf
marload/deep-rl-tf2 tf
mavischer/DRRL pytorch
miyosuda/async_deep_reinforce tf
muupan/async-rl
natsumeS/analysis
nvlabs/gbrl_sb3 pytorch
ofekluis/sonic_project_ss19
openai/universe-starter-agent tf
pytorch/rl/tree/main/examples/a2c jax
qihongl/demo-advantage-actor-critic pytorch
qihongl/dlstm-demo pytorch
ray-project/ray/tree/master/rllib
roop-pal/Meta-Learning-for-StarCraft-II-Minigames tf
sainijagjit/A3C-Pytorch pytorch
sharan-dce/A3C tf
tensorlayer/RLzoo tf
tensorpack/tensorpack/tree/master/examples/A3C-Gym tf
toni-sm/skrl jax
traai/async-deep-rl tf
uvipen/Super-mario-bros-A3C-pytorch pytorch
vladfi1/universe-starter-agent tf
wtingda/DeepRLBreakout tf
wxj77/TransferReinforcementLearning tf
yukezhu/tensorflow-reinforce tf

Tasks

Atari GamesCPUDeep Reinforcement LearningGPUreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…
Entropy Regularization 설명 없음

Similar Papers 제목 키워드 기반

Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games

2022-09-21 · Hui Bai, Ruimin Shen, Yue Lin, Botian Xu 외

Despite the emerging progress of integrating evolutionary computation into reinforcement learning, the absence of a high-performance platform endowing composability and massive parallelism causes non-trivial difficulties…

CPUDistributed Computingreinforcement-learningReinforcement Learning+2

Asynchronous Methods for Model-Based Reinforcement Learning

2019-10-28 · Yunzhi Zhang, Ignasi Clavera, Boren Tsai, Pieter Abbeel

Significant progress has been made in the area of model-based reinforcement learning. State-of-the-art algorithms are now able to match the asymptotic performance of model-free methods while being significantly more data…

modelModel-based Reinforcement LearningMuJoCoreinforcement-learning+2

Asynchronous Policy Gradient Aggregation for Efficient Distributed Reinforcement Learning

2025-09-29 · Alexander Tyurin, Andrei Spiridonov, Varvara Rudenko arxiv

We study distributed reinforcement learning (RL) with policy gradient methods under asynchronous and parallel computations and communications. While non-distributed methods are well understood theoretically and have achi…

Reinforcement Learning

An Efficient Asynchronous Method for Integrating Evolutionary and Gradient-based Policy Search

2020-12-10 · NeurIPS 2020 12 · Kyunghyun Lee, Byeong-Uk Lee, Ukcheol Shin, In So Kweon

Deep reinforcement learning (DRL) algorithms and evolution strategies (ES) have been applied to various tasks, showing excellent performances. These have the opposite properties, with DRL having good sample efficiency an…

continuous-controlContinuous ControlDeep Reinforcement LearningPolicy Gradient Methods+3

Asynchronous Actor-Critic for Multi-Agent Reinforcement Learning

2022-09-20 · Yuchen Xiao, Weihao Tan, Christopher Amato

Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn …

Decision MakingMulti-agent Reinforcement LearningPolicy Gradient Methodsreinforcement-learning+2