A deep learning approach for understanding natural language commands for mobile service robots
Using natural language to give instructions to robots is challenging, since natural language understanding is still largely an open problem. In this paper we address this problem by restricting our attention to commands modeled as one action, plus arguments (also known as slots). For action detection (also called intent detection) and slot filling various architectures of Recurrent Neural Networks and Long Short Term Memory (LSTM) networks were evaluated, having LSTMs achieved a superior accuracy. As the action requested may not fall within the robots capabilities, a Support Vector Machine(SVM) is used to determine whether it is or not. For the input of the neural networks, several word embedding algorithms were compared. Finally, to implement the system in a robot, a ROS package is created using a SMACH state machine. The proposed system is then evaluated both using well-known datasets and benchmarks in the context of domestic service robots.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionIntent DetectionNatural Language Understandingslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
Improving Grounded Natural Language Understanding through Human-Robot Dialog
Natural language understanding for robotics can require substantial domain- and platform-specific engineering. For example, for mobile robots to pick-and-place objects in an environment to satisfy human commands, we can …
Natural Language UnderstandingLanguage Understanding for Field and Service Robots in a Priori Unknown Environments
Contemporary approaches to perception, planning, estimation, and control have allowed robots to operate robustly as our remote surrogates in uncertain, unstructured environments. This progress now creates an opportunity …
Imitation LearningNatural Language UnderstandingNeural Semantic Parsing with Anonymization for Command Understanding in General-Purpose Service Robots
Service robots are envisioned to undertake a wide range of tasks at the request of users. Semantic parsing is one way to convert natural language commands given to these robots into executable representations. Methods fo…
Semantic ParsingWord EmbeddingsA Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
As the first robotic platforms slowly approach our everyday life, we can imagine a near future where service robots will be easily accessible by non-expert users through vocal interfaces. The capability of managing natur…
Natural Language UnderstandingSemantic ParsingCommonsense inference in human-robot communication
Natural language communication between machines and humans are still constrained. The article addresses a gap in natural language understanding about actions, specifically that of understanding commands. We propose a new…
Natural Language Understanding