paper-with-me

Papers

GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation

2026-05-21 · Jiahao Yang, Zihan Wang, Xiangyang Li, Xing Zhu, Yujun Shen, Yinghao Xu, Shuqiang Jiang arxiv

Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens and lack explicit spatial structure, resulting in substantial computational overhead and limited spatial reasoning. To address these issues, we introduce the Geometry-Aware BEV (GA-BEV) - a compact, 3D-grounded feature representation that integrates both explicit and implicit geometric cues into multimodal large language model (MLLM) - based navigation systems. We construct BEV spatial maps from RGB-D inputs by projecting visual features into 3D space and aggregating them into an agent-centric layout that preserves geometric consistency while reducing token redundancy. To further enrich geometric understanding, we incorporate features from a pretrained 3D foundation model into the BEV space, injecting structural priors learned from large-scale 3D reconstruction tasks. Together, these complementary cues - explicit depth-based projection and implicit learned priors - yield compact yet spatially expressive representations that substantially improve navigation efficiency and performance. Experiments show that our method achieves state-of-the-art results using only navigation data, without DAgger augmentation or mixed VQA training, demonstrating the robustness and data efficiency of the proposed GA-VLN framework.

📄 PDF Abstract BibTeX arXiv:2605.22036

Code (0)

등록된 구현이 없습니다.

Tasks

Vision-Language NavigationSpatial Reasoning3D Reconstruction

Similar Papers 제목 키워드 기반

WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN

2026-08-07 · Yuehao Huang, Yunzi Wu, Xiaotao Zhang, Xinhai Li 외 arxiv

Recent vision-language navigation (VLN) systems increasingly adapt pretrained vision-language models (VLMs) into vision-language-action (VLA) policies that map egocentric observations and language instructions directly t…

Vision-Language Navigation

DyGeoVLN: Infusing Dynamic Geometry Foundation Model into Vision-Language Navigation

2026-03-22 · Xiangchen Liu, Hanghan Zheng, Jeil Jeong, Minsung Yoon 외 arxiv

Vision-language Navigation (VLN) requires an agent to understand visual observations and language instructions to navigate in unseen environments. Most existing approaches rely on static scene assumptions and struggle to…

Vision-Language Navigation

Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation

2026-06-15 · Hongchao Shu, Roger D. Soberanis-Mukul, Hao Ding, Morgan Ringel 외 arxiv

Accurate vision-based navigation in monocular endoscopy is difficult due to limited depth cues, weak tissue texture, non-rigid deformation, and substantial appearance variation across domains, all of which complicate pos…

Monocular Depth EstimationRepresentation LearningPose Estimation

VEGA: Learning Navigation VLAs from In-the-Wild Egocentric Video with Geometric Trajectory Supervision

2026-06-16 · Gershom Seneviratne, Yohan Abeysinghe, Jianyu An, Vaibhav Shende 외 arxiv

We introduce VEGA, an approach for training navigation VisionLanguage-Action (VLA) models from unlabeled egocentric navigation videos. Internet-scale egocentric videos provide a scalable source of navigation-relevant vis…

Collision Avoidance

TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model

2026-09-08 · Anqi Li, Yuxin Chen, Zhaobo Li, Zhuo Cao 외 hf

We study the problem of navigating cluttered indoor environments with a humanoid robot. Unlike conventional methods that model navigation as a 2D path planning problem, humanoid traversal in cluttered environments requir…

Vision-Language Navigation