Maximum Entropy Hindsight Experience Replay

2024-10-31 · Douglas C. Crowder, Matthew L. Trappett, Darrien M. McKenzie, Frances S. Chance

Hindsight experience replay (HER) is well-known to accelerate goal-based reinforcement learning (RL). While HER is generally applied to off-policy RL algorithms, we previously showed that HER can also accelerate on-policy algorithms, such as proximal policy optimization (PPO), for goal-based Predator-Prey environments. Here, we show that we can improve the previous PPO-HER algorithm by selectively applying HER in a principled manner.

📄 PDF Abstract BibTeX arXiv:2410.24016

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Soft Hindsight Experience Replay

2020-02-06 · Qiwei He, Liansheng Zhuang, Houqiang Li

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Re…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Maximum Entropy-Regularized Multi-Goal Reinforcement Learning

2019-05-21 · Rui Zhao, Xudong Sun, Volker Tresp

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectorie…

Multi-Goal Reinforcement Learning OpenAI Gym reinforcement-learning Reinforcement Learning+1

Deep Reinforcement Learning-based UAV Navigation and Control: A Soft Actor-Critic with Hindsight Experience Replay Approach

2021-06-02 · Myoung Hoon Lee, Jun Moon

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL a…

Deep Reinforcement Learning

Hindsight Curriculum Generation Based Multi-Goal Experience Replay

2021-01-01 · Xiaoyun Feng

In multi-goal tasks with sparse rewards, it is challenging to learn from tons of experiences with zero rewards. Hindsight experience replay (HER), which replays past experiences with additional heuristic goals, has shown…

Reinforcement Learning (RL)

Revisiting Prioritized Experience Replay: A Value Perspective

2021-02-05 · Ang A. Li, Zongqing Lu, Chenglin Miao

Experience replay enables off-policy reinforcement learning (RL) agents to utilize past experiences to maximize the cumulative reward. Prioritized experience replay that weighs experiences by the magnitude of their tempo…

Atari Games Q-Learning Reinforcement Learning (RL)