Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation
We propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for behavioral robot navigation. We use attention models to connect information from both the user instructions and a topological representation of the environment. We evaluate our model's performance on a new dataset containing 10,050 pairs of navigation instructions. Our model significantly outperforms baseline approaches. Furthermore, our results suggest that it is possible to leverage the environment map as a relevant knowledge base to facilitate the translation of free-form navigational instruction.
Code (0)
등록된 구현이 없습니다.
Tasks
FormRobot NavigationTranslationSimilar Papers 제목 키워드 기반
Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism
We propose a multi-head attention mechanism as a blending layer in a neural network model that translates natural language to a high level behavioral language for indoor robot navigation. We follow the framework establis…
Robot NavigationHigh-Level Plan for Behavioral Robot Navigation with Natural Language Directions and R-NET
When the navigational environment is known, it can be represented as a graph where landmarks are nodes, the robot behaviors that move from node to node are edges, and the route is a set of behavioral instructions. The ro…
Combinatorial OptimizationRobot NavigationGenerating Landmark Navigation Instructions from Maps as a Graph-to-Text Problem
Car-focused navigation services are based on turns and distances of named streets, whereas navigation instructions naturally used by humans are centered around physical objects called landmarks. We present a neural model…
Natural Language Landmark Navigation Instructions GenerationConstrained Robotic Navigation on Preferred Terrains Using LLMs and Speech Instruction: Exploiting the Power of Adverbs
This paper explores leveraging large language models for map-free off-road navigation using generative AI, reducing the need for traditional data collection and annotation. We propose a method where a robot receives verb…
Language ModelingLanguage ModellingLarge Language ModelSemantic SegmentationCrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation
Navigation guided by natural language instructions is particularly suitable for Domestic Service Robots that interacts naturally with users. This task involves the prediction of a sequence of actions that leads to a spec…
TranslationVision and Language Navigation