paper-with-me

Papers

R2F: Repurposing Ray Frontiers for LLM-free Object Navigation

2026-03-09 · Francesco Argenziano, John Mark Alexis Marcelo, Michele Brienza, Abdel Hakim Drid, Emanuele Musumeci, Daniele Nardi, Domenico D. Bloisi, Vincenzo Suriani arxiv

Zero-shot open-vocabulary object navigation has progressed rapidly with the emergence of large Vision-Language Models (VLMs) and Large Language Models (LLMs), now widely used as high-level decision-makers instead of end-to-end policies. Although effective, such systems often rely on iterative large-model queries at inference time, introducing latency and computational overhead that limit real-time deployment. To address this problem, we repurpose ray frontiers (R2F), a recently proposed frontier-based exploration paradigm, to develop an LLM-free framework for indoor open-vocabulary object navigation. While ray frontiers were originally used to bias exploration using semantic cues carried along rays, we reinterpret frontier regions as explicit, direction-conditioned semantic hypotheses that serve as navigation goals. Language-aligned features accumulated along out-of-range rays are stored sparsely at frontiers, where each region maintains multiple directional embeddings encoding plausible unseen content. In this way, navigation then reduces to embedding-based frontier scoring and goal tracking within a classical mapping and planning pipeline, eliminating iterative large-model reasoning. We further introduce R2F-VLN, a lightweight extension for free-form language instructions using syntactic parsing and relational verification without additional VLM or LLM components. Experiments in Habitat-sim and on a real robotic platform demonstrate competitive state-of-the-art zero-shot performance with real-time execution, achieving up to 6 times faster runtime than VLM-based alternatives.

📄 PDF Abstract BibTeX arXiv:2603.08475

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers

2023-05-26 · Junting Chen, Guohao Li, Suryansh Kumar, Bernard Ghanem 외

Object goal navigation is an important problem in Embodied AI that involves guiding the agent to navigate to an instance of the object category in an unknown environment -- typically an indoor scene. Unfortunately, curre…

Imitation LearningNavigateObjectSimultaneous Localization and Mapping

Room-Mediated Co-occurrence for Zero-Shot Object-Centric Semantic Navigation via Frontier Scoring

2026-07-28 · Adam Scicluna, Gavin Paul, Alen Alempijevic arxiv

Zero-shot ObjectNav methods increasingly use vision-language priors, but direct object-object similarity in the latent space is often a weak proxy for spatial co-occurrence. We present an analytical, training-free semant…

STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation

2026-08-28 · Yang Chen, Zhenyu Huang, Wenbo Fu, Danyang Peng 외 arxiv

Multimodal lifelong navigation requires an agent to autonomously explore unseen environments while sequentially completing navigation tasks specified by object categories, language descriptions, or reference images. Exis…

GoalVLM: VLM-driven Object Goal Navigation for Multi-Agent System

2026-03-18 · MoniJesu James, Amir Atef Habel, Aleksey Fedoseev, Dzmitry Tsetserokou arxiv

Object-goal navigation has traditionally been limited to ground robots with closed-set object vocabularies. Existing multi-agent approaches depend on precomputed probabilistic graphs tied to fixed category sets, precludi…

Spatial Reasoning

AnyGoal: Vision-Language Guided Multi-Agent Exploration for Training-Free Lifelong Navigation

2026-06-11 · MoniJesu James, Marcelino Julio Fernando, Miguel Altamirano Cabrera, Dzmitry Tsetserukou arxiv

End-to-end navigation policies trained on large simulation corpora degrade sharply when transferred to out-of-distribution scenes, categories, or goal modalities. Modular pipelines such as Modular GOAT are bottlenecked b…

Object Detection