Learning Intrinsically Motivated Options to Stimulate Policy Exploration

2020-06-12 · ICML Workshop LifelongML 2020 7 · Louis Bagot, Kevin Mets, Steven Latré

A Reinforcement Learning (RL) agent needs to find an optimal sequence of actions in order to maximize rewards. This requires consistent exploration of states and action sequences to ensure the policy found is optimal. One way to motivate exploration is through intrinsic rewards, i.e. agent-induced rewards to guide itself towards interesting behaviors. We propose to learn from such intrinsic rewards through exploration options, i.e. additional temporally-extended actions to call separate policies (or "Explorer" agents) associated to an intrinsic reward. We show that this method has several key advantages over the usual method of weighted sum of rewards, mainly task-transfer abilities and scalability to multiple reward functions.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning (RL)

Deep Learning of Intrinsically Motivated Options in the Arcade Learning Environment

2021-09-29 · Louis Bagot, Kevin Mets, Tom De Schepper, Peter Hellinckx 외

Although Intrinsic Motivation allows a Reinforcement Learning agent to generate directed behaviors in an environment, even with sparse or noisy rewards, combining intrinsic and extrinsic rewards is non trivial. As an alt…

Atari Games Benchmarking Deep Reinforcement Learning Fairness+2

Deep Intrinsically Motivated Exploration in Continuous Control

2022-10-01 · Baturay Saglam, Suleyman S. Kozat

In continuous control, exploration is often performed through undirected strategies in which parameters of the networks or selected actions are perturbed by random noise. Although the deep setting of undirected explorati…

continuous-control Continuous Control Deep Reinforcement Learning reinforcement-learning+2

Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning

2017-08-07 · Sébastien Forestier, Rémy Portelas, Yoan Mollard, Pierre-Yves Oudeyer

Intrinsically motivated spontaneous exploration is a key enabler of autonomous developmental learning in human children. It enables the discovery of skill repertoires through autotelic learning, i.e. the self-generation,…

Developmental Learning Multi-Goal Reinforcement Learning Reinforcement Learning Self-Supervised Learning

Decoupled Reinforcement Learning to Stabilise Intrinsically-Motivated Exploration

2021-07-19 · ICML Workshop URL 2021 7 · Lukas Schäfer, Filippos Christianos, Josiah P. Hanna, Stefano V. Albrecht

Intrinsic rewards can improve exploration in reinforcement learning, but the exploration process may suffer from instability caused by non-stationary reward shaping and strong dependency on hyperparameters. In this work,…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Intrinsically Guided Exploration in Meta Reinforcement Learning

2021-01-01 · Jin Zhang, Jianhao Wang, Hao Hu, Tong Chen 외

Deep reinforcement learning algorithms generally require large amounts of data to solve a single task. Meta reinforcement learning (meta-RL) agents learn to adapt to novel unseen tasks with high sample efficiency by extr…

Deep Reinforcement Learning Efficient Exploration Meta Reinforcement Learning MuJoCo+3