paper-with-me

Papers

Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning

2026-04-02 · Xueying Li, Feng Lyu, Hao Wu, Mingliu Liu, Jia-Nan Liu, Guozi Liu arxiv

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.

📄 PDF Abstract BibTeX arXiv:2604.02318

Code (0)

등록된 구현이 없습니다.

Tasks

Vision-Language Navigation

Similar Papers 제목 키워드 기반

Think before Go: Hierarchical Reasoning for Image-goal Navigation

2026-04-19 · Pengna Li, Kangyi Wu, Shaoqing Xu, Fang Li 외 arxiv

Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similar…

Reinforcement Learning

Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation

2020-09-28 · Findings of the Association for Computational Linguistics 2020 · Jiannan Xiang, Xin Eric Wang, William Yang Wang

Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to rec…

NavigateVision and Language NavigationVision-Language Navigation

Extended Abstract: Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

2020-06-12 · ICML Workshop LaReL 2020 7 · Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson 외

Following a navigation instruction such as 'Walk down the stairs and stop near the sofa' requires an agent to ground scene elements referenced via language (e.g.'stairs') to visual content in the environment (pixels corr…

Vision and Language Navigation

AgentVLN: Towards Agentic Vision-and-Language Navigation

2026-03-18 · Zihao Xin, Wentong Li, Yixuan Jiang, Ziyuan Huang 외 arxiv

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D sem…

Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

2020-04-30 · ECCV 2020 8 · Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson 외

Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environme…

Vision and Language Navigation