paper-with-me

Papers

Virtual Guidance as a Mid-level Representation for Navigation with Augmented Reality

2023-03-05 · Hsuan-Kung Yang, Tsung-Chih Chiang, Jou-Min Liu, Ting-Ru Liu, Chun-Wei Huang, Tsu-Ching Hsiao, Chun-Yi Lee

In the context of autonomous navigation, effectively conveying abstract navigational cues to agents in dynamic environments presents significant challenges, particularly when navigation information is derived from diverse modalities such as both vision and high-level language descriptions. To address this issue, we introduce a novel technique termed `Virtual Guidance,' which is designed to visually represent non-visual instructional signals. These visual cues are overlaid onto the agent's camera view and served as comprehensible navigational guidance signals. To validate the concept of virtual guidance, we propose a sim-to-real framework that enables the transfer of the trained policy from simulated environments to real world, ensuring the adaptability of virtual guidance in practical scenarios. We evaluate and compare the proposed method against a non-visual guidance baseline through detailed experiments in simulation. The experimental results demonstrate that the proposed virtual guidance approach outperforms the baseline methods across multiple scenarios and offers clear evidence of its effectiveness in autonomous navigation tasks.

📄 PDF Abstract BibTeX arXiv:2303.02731

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous NavigationUnity

Similar Papers 제목 키워드 기반

3D Augmented Reality-Assisted CT-Guided Interventions: System Design and Preclinical Trial on an Abdominal Phantom using HoloLens 2

2020-05-19 · Brian J. Park, Stephen J. Hunt, Gregory J. Nadolski, Terence P. Gade

Background: Out-of-plane lesions pose challenges for CT-guided interventions. Augmented reality (AR) headset devices have evolved and are readily capable to provide virtual 3D guidance to improve CT-guided targeting. Pur…

IGUANA: Immersive Guidance, Navigation, and Control for Consumer UAV

2025-10-08 · Victor Victor, Tania Krisanty, Matthew McGinity, Stefan Gumhold 외 arxiv

As the markets for unmanned aerial vehicles (UAVs) and mixed reality (MR) headsets continue to grow, recent research has increasingly explored their integration, which enables more intuitive, immersive, and situationally…

Vi-LAD: Vision-Language Attention Distillation for Socially-Aware Robot Navigation in Dynamic Environments

2025-03-12 · Mohamed Elnoor, Kasun Weerakoon, Gershom Seneviratne, Jing Liang 외

We introduce Vision-Language Attention Distillation (Vi-LAD), a novel approach for distilling socially compliant navigation knowledge from a large Vision-Language Model (VLM) into a lightweight transformer model for real…

Knowledge DistillationMotion PlanningRobot Navigation

An Embodied AR Navigation Agent: Integrating BIM with Retrieval-Augmented Generation for Language Guidance

2025-08-10 · Hsuan-Kung Yang, Tsu-Ching Hsiao, Ryoichiro Oka, Ryuya Nishino 외 arxiv

Delivering intelligent and adaptive navigation assistance in augmented reality (AR) requires more than visual cues, as it demands systems capable of interpreting flexible user intent and reasoning over both spatial and s…

Spatial Reasoning

Learning to Retrieve Navigable Candidates for Efficient Vision-and-Language Navigation

2026-02-17 · Shutian Gu, Chengkai Huang, Ruoyu Wang, Lina Yao arxiv

Vision-and-Language Navigation (VLN) requires an agent to follow natural-language instructions and navigate through previously unseen environments. Recent approaches increasingly employ large language models (LLMs) as hi…