SGN-CIRL: Scene Graph-based Navigation with Curriculum, Imitation, and Reinforcement Learning

2025-06-04 · Nikita Oskolkov, Huzhenyu Zhang, Dmitry Makarov, Dmitry Yudin, Aleksandr Panov

The 3D scene graph models spatial relationships between objects, enabling the agent to efficiently navigate in a partially observable environment and predict the location of the target object.This paper proposes an original framework named SGN-CIRL (3D Scene Graph-Based Reinforcement Learning Navigation) for mapless reinforcement learning-based robot navigation with learnable representation of open-vocabulary 3D scene graph. To accelerate and stabilize the training of reinforcement learning-based algorithms, the framework also employs imitation learning and curriculum learning. The first one enables the agent to learn from demonstrations, while the second one structures the training process by gradually increasing task complexity from simple to more advanced scenarios. Numerical experiments conducted in the Isaac Sim environment showed that using a 3D scene graph for reinforcement learning significantly increased the success rate in difficult navigation cases. The code is open-sourced and available at: https://github.com/Xisonik/Aloha\_graph.

📄 PDF Abstract BibTeX arXiv:2506.04505

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningNavigatereinforcement-learning Reinforcement Learning Robot Navigation

CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-driving

2018-07-10 · ECCV 2018 9 · Xiaodan Liang, Tairui Wang, Luona Yang, Eric Xing

Autonomous urban driving navigation with complex multi-agent dynamics is under-explored due to the difficulty of learning an optimal driving policy. The traditional modular pipeline heavily relies on hand-designed rules …

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Interaction-limited Inverse Reinforcement Learning

2020-07-01 · Martin Troussard, Emmanuel Pignat, Parameswaran Kamalaruban, Sylvain Calinon 외

This paper proposes an inverse reinforcement learning (IRL) framework to accelerate learning when the learner-teacher \textit{interaction} is \textit{limited} during training. Our setting is motivated by the realistic sc…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Consistent Zero-Shot Imitation with Contrastive Goal Inference

2025-10-20 · Kathryn Wantlin, Chongyi Zheng, Benjamin Eysenbach arxiv

Zero-shot imitation learning requires an agent to reproduce expert behavior from a single demonstration without additional environment interaction or gradient updates at test time. We introduce Contrastive Inverse Reinfo…

Reinforcement Learning

Cooperative Inverse Reinforcement Learning

2016-06-09 · NeurIPS 2016 12 · Dylan Hadfield-Menell, Anca Dragan, Pieter Abbeel, Stuart Russell

For an autonomous system to be helpful to humans and to pose no unwarranted risks, it needs to align its values with those of the humans in its environment in such a way that its actions contribute to the maximization of…

Active Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Scene Representation using 360° Saliency Graph and its Application in Vision-based Indoor Navigation

2026-03-20 · Preeti Meena, Himanshu Kumar, Sandeep Yadav arxiv

A Scene, represented visually using different formats such as RGB-D, LiDAR scan, keypoints, rectangular, spherical, multi-views, etc., contains information implicitly embedded relevant to applications such as scene index…