paper-with-me

홈 › Papers

LLMs for Text-Based Exploration and Navigation Under Partial Observability

2026-03-10 · Stephan Sandfuchs, Maximilian Melchert, Jörg Frochte arxiv

Exploration and goal-directed navigation in unknown layouts are central to inspection, logistics, and search-and-rescue. We ask whether large language models (LLMs) can function as \emph{text-only} controllers under partial observability -- without code execution, tools, or program synthesis. We introduce a reproducible benchmark with oracle localisation in fixed ASCII gridworlds: each step reveals only a local $5\times5$ window around the agent and the model must select one of \texttt{UP/RIGHT/DOWN/LEFT}. Nine contemporary LLMs ranging from open/proprietary, dense / Mixture of Experts and instruction- vs. reasoning-tuned are evaluated on two tasks across three layouts of increasing difficulty: \emph{Exploration} (maximising revealed cells) and \emph{Navigation} (reach the goal on the shortest path). The experimental results are evaluated on quantitative metrics including \emph{success rate}, \emph{efficiency} such as normalised coverage and \emph{path length} vs. oracle as well as qualitative analysis. Reasoning-tuned models reliably complete navigation across all layouts, yet remain less efficient than oracle paths. Few-shot demonstrations in the prompt chiefly help these Reasoning-tuned models by reducing invalid moves and shortening paths, while classic dense instruction models remain inconsistent. We observe characteristic action priors (UP/RIGHT) that can induce looping under partial observability. Overall, training regimen and test-time deliberation predict control ability better than raw parameter count. These findings suggest lightweight hybridisation with classical online planners as a practical route to deployable partial map systems.

📄 PDF Abstract BibTeX arXiv:2604.09604

Code (0)

등록된 구현이 없습니다.

Tasks

Program Synthesis

Similar Papers 제목 키워드 기반

Follow the Signs: Using Textual Cues and LLMs to Guide Efficient Robot Navigation

2026-01-10 · Jing Cao, Nishanth Kumar, Aidan Curtis arxiv

Autonomous navigation in unfamiliar environments often relies on geometric mapping and planning strategies that overlook rich semantic cues such as signs, room numbers, and textual labels. We propose a novel semantic nav…

Robot Navigation

Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigation

2025-02-20 · Lingfeng Zhang, Yuecheng Liu, Zhanguang Zhang, Matin Aghaei 외

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient expl…

Decision MakingEfficient ExplorationSpatial Reasoning

Plan-MCTS: Plan Exploration for Action Exploitation in Web Navigation

2026-02-15 · Weiming Zhang, Jihong Wang, Jiamu Zhou, Qingyao Li 외 arxiv

Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning, applying these algorithms in web navigat…

Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigation

2023-03-06 · Vishnu Sashank Dorbala, James F. Mullen Jr., Dinesh Manocha

We present LGX (Language-guided Exploration), a novel algorithm for Language-Driven Zero-Shot Object Goal Navigation (L-ZSON), where an embodied agent navigates to a uniquely described target object in a previously unsee…

Motion PlanningObjectobject-detectionObject Detection+1

MUVLA: Learning to Explore Object Navigation via Map Understanding

2025-09-30 · Peilong Han, Fan Jia, Min Zhang, Yutao Qiu 외 arxiv

In this paper, we present MUVLA, a Map Understanding Vision-Language-Action model tailored for object navigation. It leverages semantic map abstractions to unify and structure historical information, encoding spatial con…