Hierarchical reinforcement learning for efficient exploration and transfer

2020-11-12 · Lorenzo Steccanella, Simone Totaro, Damien Allonsius, Anders Jonsson

Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing the number of decisions necessary before obtaining a reward. In this paper, we present a novel hierarchical reinforcement learning framework based on the compression of an invariant state space that is common to a range of tasks. The algorithm introduces subtasks which consist of moving between the state partitions induced by the compression. Results indicate that the algorithm can successfully solve complex sparse-reward domains, and transfer knowledge to solve new, previously unseen tasks more quickly.

📄 PDF Abstract BibTeX arXiv:2011.06335

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient ExplorationHierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical reinforcement learning for efficent exploration and transfer

2020-06-12 · ICML Workshop LifelongML 2020 7 · Lorenzo Steccanella, Simone Totaro, Damien Allonsius, Anders Jonsson

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-based Lifelong Reinforcement Learning with Bayesian Exploration

2022-10-20 · Haotian Fu, Shangqun Yu, Michael Littman, George Konidaris

We propose a model-based lifelong reinforcement-learning approach that estimates a hierarchical Bayesian posterior distilling the common structure shared across different tasks. The learned posterior combined with a samp…

model reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Reinforcement Learning in Complex 3D Environments

2023-02-28 · Bernardo Avila Pires, Feryal Behbahani, Hubert Soyer, Kyriacos Nikiforou 외

Hierarchical Reinforcement Learning (HRL) agents have the potential to demonstrate appealing capabilities such as planning and exploration with abstraction, transfer, and skill reuse. Recent successes with HRL across dif…

Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Causality-driven Hierarchical Structure Discovery for Reinforcement Learning

2022-10-13 · Shaohui Peng, Xing Hu, Rui Zhang, Ke Tang 외

Hierarchical reinforcement learning (HRL) effectively improves agents' exploration efficiency on tasks with sparse reward, with the guide of high-quality hierarchical structures (e.g., subgoals or options). However, how …

Hierarchical Reinforcement Learning Minecraft reinforcement-learning Reinforcement Learning+1

Learning to Interrupt: A Hierarchical Deep Reinforcement Learning Framework for Efficient Exploration

2018-07-30 · Tingguang Li, Jin Pan, Delong Zhu, Max Q. -H. Meng

To achieve scenario intelligence, humans must transfer knowledge to robots by developing goal-oriented algorithms, which are sometimes insensitive to dynamically changing environments. While deep reinforcement learning a…

Deep Reinforcement Learning Efficient Exploration Hierarchical Reinforcement Learning Policy Gradient Methods+3