Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots

2025-04-26 · Brendon Johnson, Alfredo Weitzenfeld

Hierarchical reinforcement learning (HRL) is hypothesized to be able to take advantage of the inherent hierarchy in robot learning tasks with sparse reward schemes, in contrast to more traditional reinforcement learning algorithms. In this research, hierarchical reinforcement learning is evaluated and contrasted with standard reinforcement learning in complex navigation tasks. We evaluate unique characteristics of HRL, including their ability to create sub-goals and the termination function. We constructed experiments to test the differences between PPO and HRL, different ways of creating sub-goals, manual vs automatic sub-goal creation, and the effects of the frequency of termination on performance. These experiments highlight the advantages of HRL and how it achieves these advantages.

📄 PDF Abstract BibTeX arXiv:2504.18794

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

ReProHRL: Towards Multi-Goal Navigation in the Real World using Hierarchical Agents

2023-08-17 · Tejaswini Manjunath, Mozhgan Navardi, Prakhar Dixit, Bharat Prakash 외

Robots have been successfully used to perform tasks with high precision. In real-world environments with sparse rewards and multiple goals, learning is still a major challenge and Reinforcement Learning (RL) algorithms f…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation

2026-06-01 · Xiang Fang, Wanlong Fang, Changshuo Wang arxiv

Vision-Language Navigation in Continuous Environments (VLN-CE) poses a formidable challenge for autonomous agents, requiring seamless integration of natural language instructions and visual observations to navigate compl…

Vision-Language Navigation Reinforcement Learning Scene Understanding Spatial Reasoning

GUIDE: Goal-Initialized Directional Understanding for End-to-End Visual Navigation

2026-06-09 · Liang Wang, Jin Jin, KanZhong Yao, YiBin Wu 외 arxiv

Learning-based visual navigation for legged robots typically relies on continuous goal updates from hierarchical state estimation to provide a persistent directional reference. This reliance incurs additional sensory and…

Reinforcement Learning Visual Navigation

Hierarchical Reinforcement Learning for Safe Mapless Navigation with Congestion Estimation

2025-03-15 · Jianqi Gao, Xizheng Pang, Qi Liu, YanJie Li

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing…

Hierarchical Reinforcement Learning Motion Planning reinforcement-learning Reinforcement Learning+1

Learning Graph-Enhanced Commander-Executor for Multi-Agent Navigation

2023-02-08 · Xinyi Yang, Shiyu Huang, Yiwen Sun, Yuxiang Yang 외

This paper investigates the multi-agent navigation problem, which requires multiple agents to reach the target goals in a limited time. Multi-agent reinforcement learning (MARL) has shown promising results for solving th…

Hierarchical Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)