From Route Instructions to Landmark Graphs
Landmarks are central to how people navigate, but most navigation technologies do not incorporate them into their representations. We propose the landmark graph generation task (creating landmark-based spatial representations from natural language) and introduce a fully end-to-end neural approach to generate these graphs. We evaluate our models on the SAIL route instruction dataset, as well as on a small set of real-world delivery instructions that we collected, and we show that our approach yields high quality results on both our task and the related robotic navigation task.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph GenerationNavigateSimilar Papers 제목 키워드 기반
An algorithm for the selection of route dependent orientation information
Landmarks are important features of spatial cognition. Landmarks are naturally included in human route descriptions and in the past algorithms were developed to select the most salient landmarks at decision points and au…
Generating Landmark Navigation Instructions from Maps as a Graph-to-Text Problem
Car-focused navigation services are based on turns and distances of named streets, whereas navigation instructions naturally used by humans are centered around physical objects called landmarks. We present a neural model…
Natural Language Landmark Navigation Instructions GenerationLess is More: Generating Grounded Navigation Instructions from Landmarks
We study the automatic generation of navigation instructions from 360-degree images captured on indoor routes. Existing generators suffer from poor visual grounding, causing them to rely on language priors and hallucinat…
DecoderInstruction FollowingVisual GroundingTalk2Nav: Long-Range Vision-and-Language Navigation with Dual Attention and Spatial Memory
The role of robots in society keeps expanding, bringing with it the necessity of interacting and communicating with humans. In order to keep such interaction intuitive, we provide automatic wayfinding based on verbal nav…
Autonomous DrivingVision and Language NavigationVisual NavigationHigh-Level Plan for Behavioral Robot Navigation with Natural Language Directions and R-NET
When the navigational environment is known, it can be represented as a graph where landmarks are nodes, the robot behaviors that move from node to node are edges, and the route is a set of behavioral instructions. The ro…
Combinatorial OptimizationRobot Navigation