Random Latent Exploration for Deep Reinforcement Learning

2024-07-18 · Srinath Mahankali, Zhang-Wei Hong, Ayush Sekhari, Alexander Rakhlin, Pulkit Agrawal

The ability to efficiently explore high-dimensional state spaces is essential for the practical success of deep Reinforcement Learning (RL). This paper introduces a new exploration technique called Random Latent Exploration (RLE), that combines the strengths of bonus-based and noise-based (two popular approaches for effective exploration in deep RL) exploration strategies. RLE leverages the idea of perturbing rewards by adding structured random rewards to the original task rewards in certain (random) states of the environment, to encourage the agent to explore the environment during training. RLE is straightforward to implement and performs well in practice. To demonstrate the practical effectiveness of RLE, we evaluate it on the challenging Atari and IsaacGym benchmarks and show that RLE exhibits higher overall scores across all the tasks than other approaches.

📄 PDF Abstract BibTeX arXiv:2407.13755

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Information Content Exploration

2023-10-10 · Jacob Chmura, Hasham Burhani, Xiao Qi Shi

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information ab…

Efficient Exploration reinforcement-learning Reinforcement Learning

Meta-Reinforcement Learning of Structured Exploration Strategies

2018-02-20 · NeurIPS 2018 12 · Abhishek Gupta, Russell Mendonca, Yuxuan Liu, Pieter Abbeel 외

Exploration is a fundamental challenge in reinforcement learning (RL). Many of the current exploration methods for deep RL use task-agnostic objectives, such as information gain or bonuses based on state visitation. Howe…

Meta Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

IIB-LPO: Latent Policy Optimization via Iterative Information Bottleneck

2026-01-09 · Huilin Deng, Hongchen Luo, Yue Zhu, Long Li 외 arxiv

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rol…

Reinforcement Learning Mathematical Reasoning

Balancing Exploration and Exploitation in Hierarchical Reinforcement Learning via Latent Landmark Graphs

2023-07-22 · Qingyang Zhang, Yiming Yang, Jingqing Ruan, Xuantang Xiong 외

Goal-Conditioned Hierarchical Reinforcement Learning (GCHRL) is a promising paradigm to address the exploration-exploitation dilemma in reinforcement learning. It decomposes the source task into subgoal conditional subta…

continuous-control Continuous Control Hierarchical Reinforcement Learning reinforcement-learning+2

Deep Exploration via Randomized Value Functions

2017-03-22 · Ian Osband, Benjamin Van Roy, Daniel Russo, Zheng Wen

We study the use of randomized value functions to guide deep exploration in reinforcement learning. This offers an elegant means for synthesizing statistically and computationally efficient exploration with common practi…

Efficient Exploration reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)