SkeNa: Learning to Navigate Unseen Environments Based on Abstract Hand-Drawn Maps

2025-08-05 · Haojun Xu, Jiaqi Xiang, Wu Wei, Jinyu Chen, Linqing Zhong, Linjiang Huang, Hongyu Yang, Si Liu arxiv

A typical human strategy for giving navigation guidance is to sketch route maps based on the environmental layout. Inspired by this, we introduce Sketch map-based visual Navigation (SkeNa), an embodied navigation task in which an agent must reach a goal in an unseen environment using only a hand-drawn sketch map as guidance. To support research for SkeNa, we present a large-scale dataset named SoR, comprising 54k trajectory and sketch map pairs across 71 indoor scenes. In SoR, we introduce two navigation validation sets with varying levels of abstraction in hand-drawn sketches, categorized based on their preservation of spatial scales in the environment, to facilitate future research. To construct SoR, we develop an automated sketch-generation pipeline that efficiently converts floor plans into hand-drawn representations. To solve SkeNa, we propose SkeNavigator, a navigation framework that aligns visual observations with hand-drawn maps to estimate navigation targets. It employs a Ray-based Map Descriptor (RMD) to enhance sketch map valid feature representation using equidistant sampling points and boundary distances. To improve alignment with visual observations, a Dual-Map Aligned Goal Predictor (DAGP) leverages the correspondence between sketch map features and on-site constructed exploration map features to predict goal position and guide navigation. SkeNavigator outperforms prior floor plan navigation methods by a large margin, improving SPL on the high-abstract validation set by 105% relatively. Our code and dataset will be released.

📄 PDF Abstract BibTeX arXiv:2508.03053

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Navigation

Robot Navigation in Unseen Spaces using an Abstract Map

2020-01-31 · Ben Talbot, Feras Dayoub, Peter Corke, Gordon Wyeth

Human navigation in built environments depends on symbolic spatial information which has unrealised potential to enhance robot navigation capabilities. Information sources such as labels, signs, maps, planners, spoken di…

Navigate Robot Navigation

Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout

2019-04-08 · NAACL 2019 6 · Hao Tan, Licheng Yu, Mohit Bansal

A grand goal in AI is to build a robot that can accurately navigate based on natural language instructions, which requires the agent to perceive the scene, understand and ground language, and act in the real-world enviro…

Navigate Reinforcement Learning Translation Vision-Language Navigation

Learning Your Way Without Map or Compass: Panoramic Target Driven Visual Navigation

2019-09-20 · David Watkins-Valls, Jingxi Xu, Nicholas Waytowich, Peter Allen

We present a robot navigation system that uses an imitation learning framework to successfully navigate in complex environments. Our framework takes a pre-built 3D scan of a real environment and trains an agent from pre-…

Imitation Learning Navigate Position Reinforcement Learning+2

Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps

2024-12-16 · Linfeng Zhao, Lawson L. S. Wong

Learning navigation capabilities in different environments has long been one of the major challenges in decision-making. In this work, we focus on zero-shot navigation ability using given abstract $2$-D top-down maps. Li…

Decision Making Model-based Reinforcement Learning Multi-Task Learning Navigate

Dynamic probabilistic logic models for effective abstractions in RL

2021-10-15 · Harsha Kokel, Arjun Manoharan, Sriraam Natarajan, Balaraman Ravindran 외

State abstraction enables sample-efficient learning and better task transfer in complex reinforcement learning environments. Recently, we proposed RePReL (Kokel et al. 2021), a hierarchical framework that leverages a rel…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)