Curiosity-driven Exploration for Mapless Navigation with Deep Reinforcement Learning

2018-04-02 · Oleksii Zhelo, Jingwei Zhang, Lei Tai, Ming Liu, Wolfram Burgard

This paper investigates exploration strategies of Deep Reinforcement Learning (DRL) methods to learn navigation policies for mobile robots. In particular, we augment the normal external reward for training DRL algorithms with intrinsic reward signals measured by curiosity. We test our approach in a mapless navigation setting, where the autonomous agent is required to navigate without the occupancy map of the environment, to targets whose relative locations can be easily acquired through low-cost solutions (e.g., visible light localization, Wi-Fi signal localization). We validate that the intrinsic motivation is crucial for improving DRL performance in tasks with challenging exploration requirements. Our experimental results show that our proposed method is able to more effectively learn navigation policies, and has better generalization capabilities in previously unseen environments. A video of our experimental results can be found at https://goo.gl/pWbpcF.

📄 PDF Abstract BibTeX arXiv:1804.00456

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningNavigatereinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Curiosity-Driven Multi-Agent Exploration with Mixed Objectives

2022-10-29 · Roben Delos Reyes, Kyunghwan Son, Jinhwan Jung, Wan Ju Kang 외

Intrinsic rewards have been increasingly used to mitigate the sparse reward problem in single-agent reinforcement learning. These intrinsic rewards encourage the agent to look for novel experiences, guiding the agent to …

See, Hear, Explore: Curiosity via Audio-Visual Association

2020-07-07 · NeurIPS 2020 12 · Victoria Dean, Shubham Tulsiani, Abhinav Gupta

Exploration is one of the core challenges in reinforcement learning. A common formulation of curiosity-driven exploration uses the difference between the real future and the future predicted by a learned model. However, …

Efficient Exploration

Hierarchical Reinforcement Learning for Safe Mapless Navigation with Congestion Estimation

2025-03-15 · Jianqi Gao, Xizheng Pang, Qi Liu, YanJie Li

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing…

Hierarchical Reinforcement Learning Motion Planning reinforcement-learning Reinforcement Learning+1

Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation

2017-03-01 · Lei Tai, Giuseppe Paolo, Ming Liu

We present a learning-based mapless motion planner by taking the sparse 10-dimensional range findings and the target position with respect to the mobile robot coordinate frame as input and the continuous steering command…

continuous-control Continuous Control Deep Reinforcement Learning Navigate+3

CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidance

2025-03-05 · Arthur Zhang, Harshit Sikchi, Amy Zhang, Joydeep Biswas

We introduce CREStE, a scalable learning-based mapless navigation framework to address the open-world generalization and robustness challenges of outdoor urban navigation. Key to achieving this is learning perceptual rep…

Active Learning counterfactual Navigate