Hierarchical Reinforcement Learning with Deep Nested Agents

2018-05-18 · Marc Brittain, Peng Wei

Deep hierarchical reinforcement learning has gained a lot of attention in recent years due to its ability to produce state-of-the-art results in challenging environments where non-hierarchical frameworks fail to learn useful policies. However, as problem domains become more complex, deep hierarchical reinforcement learning can become inefficient, leading to longer convergence times and poor performance. We introduce the Deep Nested Agent framework, which is a variant of deep hierarchical reinforcement learning where information from the main agent is propagated to the low level $nested$ agent by incorporating this information into the nested agent's state. We demonstrate the effectiveness and performance of the Deep Nested Agent framework by applying it to three scenarios in Minecraft with comparisons to a deep non-hierarchical single agent framework, as well as, a deep hierarchical framework.

📄 PDF Abstract BibTeX arXiv:1805.07008

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement LearningMinecraftreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Framework for Constrained and Adaptive Behavior-Based Agents

2015-06-07 · Renato de Pontes Pereira, Paulo Martins Engel

Behavior Trees are commonly used to model agents for robotics and games, where constrained behaviors must be designed by human experts in order to guarantee that these agents will execute a specific chain of actions give…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-layer Abstraction for Nested Generation of Options (MANGO) in Hierarchical Reinforcement Learning

2025-08-25 · Alessio Arcudi, Davide Sartor, Alberto Sinigaglia, Vincent François-Lavet 외 arxiv

This paper introduces MANGO (Multilayer Abstraction for Nested Generation of Options), a novel hierarchical reinforcement learning framework designed to address the challenges of long-term sparse reward environments. MAN…

Hierarchical Reinforcement Learning

Nested Policy Reinforcement Learning for Clinical Decision Support

2021-09-29 · Aishwarya Mandyam, Andrew Jones, Krzysztof Laudanski, Barbara Engelhardt

Off-policy reinforcement learning (RL) has proven to be a powerful framework for guiding agents' actions in environments with stochastic rewards and unknown or noisy state dynamics. In many real-world settings, these age…

Decision Making Navigate OpenAI Gym reinforcement-learning+2

Hierarchical Reinforcement Learning in Complex 3D Environments

2023-02-28 · Bernardo Avila Pires, Feryal Behbahani, Hubert Soyer, Kyriacos Nikiforou 외

Hierarchical Reinforcement Learning (HRL) agents have the potential to demonstrate appealing capabilities such as planning and exploration with abstraction, transfer, and skill reuse. Recent successes with HRL across dif…

Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mind

2025-05-18 · Rikunari Sagara, Koichiro Terao, Naoto Iwahashi

This paper introduces an open-source simulator, BeliefNest, designed to enable embodied agents to perform collaborative tasks by leveraging Theory of Mind. BeliefNest dynamically and hierarchically constructs simulators …

Minecraft