paper-with-me

홈 › Papers

Learning from Hallucinating Critical Points for Navigation in Dynamic Environments

2025-09-30 · Saad Abdul Ghani, Kameron Lee, Xuesu Xiao arxiv

Generating large and diverse obstacle datasets to learn motion planning in environments with dynamic obstacles is challenging due to the vast space of possible obstacle trajectories. Inspired by hallucination-based data synthesis approaches, we propose Learning from Hallucinating Critical Points (LfH-CP), a self-supervised framework for creating rich dynamic obstacle datasets based on existing optimal motion plans without requiring expensive expert demonstrations or trial-and-error exploration. LfH-CP factorizes hallucination into two stages: first identifying when and where obstacles must appear in order to result in an optimal motion plan, i.e., the critical points, and then procedurally generating diverse trajectories that pass through these points while avoiding collisions. This factorization avoids generative failures such as mode collapse and ensures coverage of diverse dynamic behaviors. We further introduce a diversity metric to quantify dataset richness and show that LfH-CP produces substantially more varied training data than existing baselines. Experiments in simulation demonstrate that planners trained on LfH-CP datasets achieves higher success rates compared to a prior hallucination method.

📄 PDF Abstract BibTeX arXiv:2509.26513

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Planning

Similar Papers 제목 키워드 기반

Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation

2026-05-25 · Kailing Li, Tianwen Qian, Lijin Yang, Yuqian Fu 외 arxiv

Vision-Language Navigation (VLN) enables embodied agents to reach target locations in unseen environments by following language instructions. Despite recent progress with vision-language models (VLMs), a critical semanti…

Vision-Language NavigationSpatial Reasoning

NavDreamer: Video Models as Zero-Shot 3D Navigators

2026-02-10 · Xijie Huang, Weiqi Gai, Tianyue Wu, Congyu Wang 외 arxiv

Previous Vision-Language-Action models face critical limitations in navigation: scarce, diverse data from labor-intensive collection and static representations that fail to capture temporal dynamics and physical laws. We…

Zero-shot Generalization

ReaDy-Go: Real-to-Sim Dynamic 3D Gaussian Splatting Simulation for Environment-Specific Visual Navigation with Moving Obstacles

2026-02-12 · Seungyeon Yoo, Youngseok Jang, Dabin Kim, Youngsoo Han 외 arxiv

Visual navigation models often struggle in real-world dynamic environments due to limited robustness to the sim-to-real gap and the difficulty of training policies tailored to target deployment environments (e.g., househ…

Visual Navigation

Dynamic Topology Awareness: Breaking the Granularity Rigidity in Vision-Language Navigation

2026-01-29 · Jiankun Peng, Jianyuan Guo, Ying Xu, Yue Liu 외 arxiv

Vision-Language Navigation in Continuous Environments (VLN-CE) presents a core challenge: grounding high-level linguistic instructions into precise, safe, and long-horizon spatial actions. Explicit topological maps have …

Vision-Language Navigation

ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments

2023-04-06 · Dong An, Hanqing Wang, Wenguan Wang, Zun Wang 외

Vision-language navigation is a task that requires an agent to follow instructions to navigate in environments. It becomes increasingly crucial in the field of embodied AI, with potential applications in autonomous navig…

Autonomous NavigationNavigateVision-Language Navigation