paper-with-me

홈 › Papers

MUVLA: Learning to Explore Object Navigation via Map Understanding

2025-09-30 · Peilong Han, Fan Jia, Min Zhang, Yutao Qiu, Hongyao Tang, Yan Zheng, Tiancai Wang, Jianye Hao arxiv

In this paper, we present MUVLA, a Map Understanding Vision-Language-Action model tailored for object navigation. It leverages semantic map abstractions to unify and structure historical information, encoding spatial context in a compact and consistent form. MUVLA takes the current and history observations, as well as the semantic map, as inputs and predicts the action sequence based on the description of goal object. Furthermore, it amplifies supervision through reward-guided return modeling based on dense short-horizon progress signals, enabling the model to develop a detailed understanding of action value for reward maximization. MUVLA employs a three-stage training pipeline: learning map-level spatial understanding, imitating behaviors from mixed-quality demonstrations, and reward amplification. This strategy allows MUVLA to unify diverse demonstrations into a robust spatial representation and generate more rational exploration strategies. Experiments on HM3D and Gibson benchmarks demonstrate that MUVLA achieves great generalization and learns effective exploration behaviors even from low-quality or partially successful trajectories.

📄 PDF Abstract BibTeX arXiv:2509.25966

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation

2025-09-10 · Michael J. Munje, Chen Tang, Shuijing Liu, Zichao Hu 외 arxiv

Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-Language Models (VLMs) exhibit promising capabilities such as object re…

Visual Question AnsweringScene UnderstandingObject RecognitionRobot Navigation

SemNav: A Model-Based Planner for Zero-Shot Object Goal Navigation Using Vision-Foundation Models

2025-06-04 · Arnab Debnath, Gregory J. Stein, Jana Kosecka

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated d…

Object

VisionGPT: LLM-Assisted Real-Time Anomaly Detection for Safe Visual Navigation

2024-03-19 · Hao Wang, Jiayou Qin, Ashish Bastola, Xiwen Chen 외

This paper explores the potential of Large Language Models(LLMs) in zero-shot anomaly detection for safe visual navigation. With the assistance of the state-of-the-art real-time open-world object detection model Yolo-Wor…

Anomaly Detectionobject-detectionObject DetectionOpen-vocabulary object detection+5

MCNav: Memory-Aware Dynamic Cognitive Map for Zero-shot Goal-oriented Navigation

2026-05-19 · Jingyu Li, Zhe Liu, Wenxiao Wu, Li Zhang arxiv

Navigating to instance-level targets in complex environments is a challenging problem. Many existing zero-shot methods achieve strong performance by modeling the entire environment and leveraging large language models fo…

Scene Understanding

Meta-Explore: Exploratory Hierarchical Vision-and-Language Navigation Using Scene Object Spectrum Grounding

2023-03-07 · CVPR 2023 1 · Minyoung Hwang, Jaeyeon Jeong, Minsoo Kim, Yoonseon Oh 외

The main challenge in vision-and-language navigation (VLN) is how to understand natural-language instructions in an unseen environment. The main limitation of conventional VLN algorithms is that if an action is mistaken,…

Vision and Language NavigationVisual Navigation