paper-with-me

Papers

Curriculum-Based Reinforcement Learning for Autonomous UAV Navigation in Unknown Curved Tubular Conduit

2025-12-11 · Zamirddine Mari, Jérôme Pasquet, Julien Seinturier arxiv

Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a reinforcement learning approach enabling a drone to navigate unknown three-dimensional tubes without any prior knowledge of their geometry, relying solely on local observations from LiDAR and a conditional visual detection of the tube center. In contrast, the Pure Pursuit algorithm, used as a deterministic baseline, benefits from explicit access to the centerline, creating an information asymmetry designed to assess the ability of RL to compensate for the absence of a geometric model. The agent is trained through a progressive Curriculum Learning strategy that gradually exposes it to increasingly curved geometries, where the tube center frequently disappears from the visual field. A turning-negotiation mechanism, based on the combination of direct visibility, directional memory, and LiDAR symmetry cues, proves essential for ensuring stable navigation under such partial observability conditions. Experiments show that the PPO policy acquires robust and generalizable behavior, consistently outperforming the deterministic controller despite its limited access to geometric information. Validation in a high-fidelity 3D environment further confirms the transferability of the learned behavior to a continuous physical dynamics. The proposed approach thus provides a complete framework for autonomous navigation in unknown tubular environments and opens perspectives for industrial, underground, or medical applications where progressing through narrow and weakly perceptive conduits represents a central challenge.

📄 PDF Abstract BibTeX arXiv:2512.10934

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningDrone navigation

Similar Papers 제목 키워드 기반

Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

2021-07-28 · Charles Sun, Jędrzej Orbik, Coline Devin, Brian Yang 외

We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement …

Continual LearningNavigatereinforcement-learningReinforcement Learning+1

Self-Supervised Curriculum Generation for Autonomous Reinforcement Learning without Task-Specific Knowledge

2023-11-15 · Sang-Hyun Lee, Seung-Woo Seo

A significant bottleneck in applying current reinforcement learning algorithms to real-world scenarios is the need to reset the environment between every episode. This reset process demands substantial human intervention…

reinforcement-learningReinforcement Learning

Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skills

2023-10-30 · Seongun Kim, Kyowoon Lee, Jaesik Choi

Mutual information-based reinforcement learning (RL) has been proposed as a promising framework for retrieving complex skills autonomously without a task-oriented reward function through mutual information (MI) maximizat…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Robot Navigation

Interaction-Aware Multi-Agent Reinforcement Learning for Mobile Agents with Individual Goals

2019-09-27 · Anahita Mohseni-Kabir, David Isele, Kikuo Fujimura

In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in…

Autonomous DrivingMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+2

Embodied Visual Navigation with Automatic Curriculum Learning in Real Environments

2020-09-11 · Steven D. Morad, Roberto Mecca, Rudra P. K. Poudel, Stephan Liwicki 외

We present NavACL, a method of automatic curriculum learning tailored to the navigation task. NavACL is simple to train and efficiently selects relevant tasks using geometric features. In our experiments, deep reinforcem…

Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)+1