RLeXplore: Accelerating Research in Intrinsically-Motivated Reinforcement Learning

2024-05-29 · Mingqi Yuan, Roger Creus Castanyer, Bo Li, Xin Jin, Glen Berseth, Wenjun Zeng

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and annotation. This limitation underscores the necessity for intrinsic rewards, which offer auxiliary and dense signals and can enable agents to learn in an unsupervised manner. Although various intrinsic reward formulations have been proposed, their implementation and optimization details are insufficiently explored and lack standardization, thereby hindering research progress. To address this gap, we introduce RLeXplore, a unified, highly modularized, and plug-and-play framework offering reliable implementations of eight state-of-the-art intrinsic reward algorithms. Furthermore, we conduct an in-depth study that identifies critical implementation details and establishes well-justified standard practices in intrinsically-motivated RL. The source code for RLeXplore is available at https://github.com/RLE-Foundation/RLeXplore.

📄 PDF Abstract BibTeX arXiv:2405.19548

Code (1)

rle-foundation/rlexplore 공식 구현 jax

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Toward Debugging Deep Reinforcement Learning Programs with RLExplorer

2024-10-06 · Rached Bouchoucha, Ahmed Haj Yahmed, Darshan Patil, Janarthanan Rajendran 외

Deep reinforcement learning (DRL) has shown success in diverse domains such as robotics, computer games, and recommendation systems. However, like any other software system, DRL-based software systems are susceptible to …

Deep Reinforcement Learning Fault Diagnosis Recommendation Systems reinforcement-learning+1

Autotelic Agents with Intrinsically Motivated Goal-Conditioned Reinforcement Learning: a Short Survey

2020-12-17 · Cédric Colas, Tristan Karch, Olivier Sigaud, Pierre-Yves Oudeyer

Building autonomous machines that can explore open-ended environments, discover possible interactions and build repertoires of skills is a general objective of artificial intelligence. Developmental approaches argue that…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Decoupled Reinforcement Learning to Stabilise Intrinsically-Motivated Exploration

2021-07-19 · ICML Workshop URL 2021 7 · Lukas Schäfer, Filippos Christianos, Josiah P. Hanna, Stefano V. Albrecht

Intrinsic rewards can improve exploration in reinforcement learning, but the exploration process may suffer from instability caused by non-stationary reward shaping and strong dependency on hyperparameters. In this work,…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Intrinsically-Motivated Reinforcement Learning: A Brief Introduction

2022-03-03 · Mingqi Yuan

Reinforcement learning (RL) is one of the three basic paradigms of machine learning. It has demonstrated impressive performance in many complex tasks like Go and StarCraft, which is increasingly involved in smart manufac…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Intrinsically Motivated Hierarchical Policy Learning in Multi-objective Markov Decision Processes

2023-08-18 · Sherif Abdelfattah, Kathryn Merrick, Jiankun Hu

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems can…

Decision Making Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning+1