paper-with-me

Papers

IntentNav: Learning Spatial-Visual Object Navigation from Human Demonstrations

2026-06-06 · Yuxin Cai, Zongtai Li, Maonan Wang, Muyi Bao, Haokun Zhu, Ruofei Bai, Ding Zhao, Zirui Li, Wenshan Wang, Wei-Yun Yau, Ji Zhang, Chen Lv arxiv

Object navigation requires a robot to search for an unobserved target in an unknown environment by deciding where to explore next under partial observability. Effective search resembles human-like exploration: selectively probing visually promising frontiers while relying on spatial memory to avoid redundant revisits. We propose IntentNav, a spatial-visual imitation framework that learns human-like ObjectNav policies from human demonstrations. To infer high-level search intent from low-level human actions, we introduce Frontier-based Human-Intent Labeling, which looks ahead in human demonstrations and labels the frontier that best explains the demonstrator's future search direction. We construct a spatial-visual candidate space, where BEV memory tracks explored regions, unexplored frontiers, and trajectory history, while egocentric visual memory provides semantic cues for each candidate. A VLM policy is trained to select among these grounded candidates, using Intent-Aligned Objective to encourage consistent and human-like exploration. IntentNav achieves state-of-the-art performance on the MP3D, HM3D-v1 and HM3D-v2 ObjectNav benchmarks. The proposed candidate-level navigation interface transfers zero-shot to wheeled, quadruped, and humanoid robots without further VLM fine-tuning. \href{https://anonymous.4open.science/w/IntentNav/}{Project page}.

📄 PDF Abstract BibTeX arXiv:2606.08029

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Navigational Visual Representations with Semantic Map Supervision

2023-07-23 · ICCV 2023 1 · Yicong Hong, Yang Zhou, Ruiyi Zhang, Franck Dernoncourt 외

Being able to perceive the semantics and the spatial structure of the environment is essential for visual navigation of a household robot. However, most existing works only employ visual backbones pre-trained either with…

Representation LearningSelf-Supervised LearningVision and Language NavigationVisual Navigation

Object-oriented Targets for Visual Navigation using Rich Semantic Representations

2018-11-22 · Jean-Benoit Delbrouck, Stéphane Dupont

When searching for an object humans navigate through a scene using semantic information and spatial relationships. We look for an object using our knowledge of its attributes and relationships with other objects to infer…

NavigateObjectVisual Navigation

ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imagination

2025-12-19 · Teng Wang, Xinxin Zhao, Wenzhe Cai, Changyin Sun arxiv

Visual navigation is a fundamental capability for autonomous home-assistance robots, enabling long-horizon tasks such as object search. While recent methods have leveraged Large Language Models (LLMs) to incorporate comm…

Spatial ReasoningVisual Navigation

VTNet: Visual Transformer Network for Object Goal Navigation

2021-05-20 · ICLR 2021 1 · Heming Du, Xin Yu, Liang Zheng

Object goal navigation aims to steer an agent towards a target object based on observations of the agent. It is of pivotal importance to design effective visual representations of the observed scene in determining naviga…

Object

Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models

2024-04-04 · Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia 외

Large language models (LLMs) have exhibited impressive performance in language comprehension and various reasoning tasks. However, their abilities in spatial reasoning, a crucial aspect of human cognition, remain relativ…

Spatial ReasoningVisual Navigation