Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism
We propose a multi-head attention mechanism as a blending layer in a neural network model that translates natural language to a high level behavioral language for indoor robot navigation. We follow the framework established by (Zang et al., 2018a) that proposes the use of a navigation graph as a knowledge base for the task. Our results show significant performance gains when translating instructions on previously unseen environments, therefore, improving the generalization capabilities of the model.
Code (0)
등록된 구현이 없습니다.
Tasks
Robot NavigationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation
We propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for behavioral robot navigation. We use attention models to connect information from both the user…
FormRobot NavigationTranslationHigh-Level Plan for Behavioral Robot Navigation with Natural Language Directions and R-NET
When the navigational environment is known, it can be represented as a graph where landmarks are nodes, the robot behaviors that move from node to node are edges, and the route is a set of behavioral instructions. The ro…
Combinatorial OptimizationRobot NavigationTranslating Natural Language Instructions to Computer Programs for Robot Manipulation
It is highly desirable for robots that work alongside humans to be able to understand instructions in natural language. Existing language conditioned imitation learning models directly predict the actuator commands from …
Imitation LearningRobot ManipulationLLMs can generate robotic scripts from goal-oriented instructions in biological laboratory automation
The use of laboratory automation by all researchers may substantially accelerate scientific activities by humans, including those in the life sciences. However, computer programs to operate robots should be written to im…
Linear Temporal Logic Translation via Human-Inspired Self-Constrained Reasoning for Robot Task Specification
Many robotic tasks are temporally extended and demand precise specifications of subgoals, constraints, and their temporal ordering. Yet human operators typically communicate such tasks in natural language, which is inher…