A Dual Memory Structure for Efficient Use of Replay Memory in Deep Reinforcement Learning

2019-07-15 · Wonshick Ko, Dong Eui Chang

In this paper, we propose a dual memory structure for reinforcement learning algorithms with replay memory. The dual memory consists of a main memory that stores various data and a cache memory that manages the data and trains the reinforcement learning agent efficiently. Experimental results show that the dual memory structure achieves higher training and test scores than the conventional single memory structure in three selected environments of OpenAI Gym. This implies that the dual memory structure enables better and more efficient training than the single memory structure.

📄 PDF Abstract BibTeX arXiv:1907.06396

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningOpenAI Gym reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Efficient Replay Memory Architectures in Multi-Agent Reinforcement Learning for Traffic Congestion Control

2024-07-22 · Mukul Chodhary, Kevin Octavian, SooJean Han

Episodic control, inspired by the role of episodic memory in the human brain, has been shown to improve the sample inefficiency of model-free reinforcement learning by reusing high-return past experiences. However, the m…

Decision Making Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Qgraph-bounded Q-learning: Stabilizing Model-Free Off-Policy Deep Reinforcement Learning

2020-07-15 · Sabrina Hoppe, Marc Toussaint

In state of the art model-free off-policy deep reinforcement learning, a replay memory is used to store past experience and derive all network updates. Even if both state and action spaces are continuous, the replay memo…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)

Augmented Replay Memory in Reinforcement Learning With Continuous Control

2019-12-29 · Mirza Ramicic, Andrea Bonarini

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment incre…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Fast deep reinforcement learning using online adjustments from the past

2018-10-18 · NeurIPS 2018 12 · Steven Hansen, Pablo Sprechmann, Alexander Pritzel, André Barreto 외

We propose Ephemeral Value Adjusments (EVA): a means of allowing deep reinforcement learning agents to rapidly adapt to experience in their replay buffer. EVA shifts the value predicted by a neural network with an estima…

Atari Games Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Transformer with Memory Replay

2022-05-19 · Rui Liu, Barzan Mozafari

Transformers achieve state-of-the-art performance for natural language processing tasks by pre-training on large-scale text corpora. They are extremely compute-intensive and have very high sample complexity. Memory repla…