paper-with-me

홈 › Papers

A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration

2026-04-23 · Kuan Xu, Ruimeng Liu, Yizhuo Yang, Denan Liang, Tongxing Jin, Shenghai Yuan, Chen Wang, Lihua Xie arxiv

Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy, and real-time execution. In vision-and-language navigation (VLN), existing approaches often face a trade-off between reasoning capability and deployment efficiency on real-world platforms. In this paper, we present a deployable embodied VLN system that achieves both high efficiency and strong high-level reasoning on real-world robots. The system is decomposed into a fast perception-action layer and a deep reasoning layer running asynchronously at different time scales, with a shared memory layer enabling efficient interaction between them. To support long-horizon reasoning, we incrementally construct a compact memory graph and progressively feed decomposed subgraphs into a vision-language model (VLM). Furthermore, we formulate exploration as a Weighted Traveling Repairman Problem (WTRP) by jointly considering reasoning outcomes and the spatial distribution of candidate regions. Extensive experiments in simulation and real-world environments demonstrate improved navigation success and efficiency over existing VLN approaches while maintaining real-time performance on resource-constrained hardware. Code and additional real-world experiments are available at https://github.com/xukuanHIT/HiCo-Nav.

📄 PDF Abstract BibTeX arXiv:2604.21363

Code (0)

등록된 구현이 없습니다.

Tasks

Vision-Language Navigation

Similar Papers 제목 키워드 기반

Automating the Design of Embodied Agent Architectures

2026-07-03 · Jian Zhou, Sihao Lin, Jin Li, Shuai Fu 외 hf

Embodied agents are typically built as hand-designed compositions of perception, memory, planning, and action modules. This modularity exposes a large architectural design space, but current systems still rely on researc…

Vision-Language NavigationQuestion Answering

Vision-Language Navigation with Embodied Intelligence: A Survey

2024-02-22 · Peng Gao, Peng Wang, Feng Gao, Fei Wang 외

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-langua…

SurveyVision-Language Navigation

SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning

2026-05-10 · Haoqiang Kang, Xiaokang Ye, Yuhan Liu, Siddhant Hitesh Mantri 외 arxiv

LLM/VLM-based digital agents have advanced rapidly thanks to scalable sandboxes for coding, web navigation, and computer use, which provide rich interactive training grounds. In contrast, embodied agents still lack abund…

3D Generation

VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents

2025-12-31 · Xunyi Zhao, Gengze Zhou, Qi Wu arxiv

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial …

Spatial ReasoningVisual Navigation

NavTrust: Benchmarking Trustworthiness for Embodied Navigation

2026-03-19 · Huaide Jiang, Yash Chaudhary, Yuping Wang, Zehao Wang 외 arxiv

There are two major categories of embodied navigation: Vision-Language Navigation (VLN), where agents navigate by following natural language instructions; and Object-Goal Navigation (OGN), where agents navigate to a spec…

Vision-Language Navigation