A Research Platform for Multi-Robot Dialogue with Humans
This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow instructions to two robotic teammates: a simulated ground robot and an aerial robot. This flexible language and robotic platform takes advantage of existing tools for speech recognition and dialogue management that are compatible with new domains, and implements an inter-agent communication protocol (tactical behavior specification), where verbal instructions are encoded for tasks assigned to the appropriate robot.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue ManagementManagementNavigatespeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Incremental Dialogue Management: Survey, Discussion, and Implications for HRI
Efforts towards endowing robots with the ability to speak have benefited from recent advancements in NLP, in particular large language models. However, as powerful as current models have become, they still operate on sen…
Dialogue ManagementManagementSentencespeech-recognition+3SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpus
We introduce the Situated Corpus Of Understanding Transactions (SCOUT), a multi-modal collection of human-robot dialogue in the task domain of collaborative exploration. The corpus was constructed from multiple Wizard-of…
Abstract Meaning RepresentationDialogue Object Search
We envision robots that can collaborate and communicate seamlessly with humans. It is necessary for such robots to decide both what to say and how to act, while interacting with humans. To this end, we introduce a new ta…
ObjectThe Niki and Julie Corpus: Collaborative Multimodal Dialogues between Humans, Robots, and Virtual Agents
Turn-Taking Strategies for Human-Robot Peer-Learning Dialogue
In this paper, we apply the contribution model of grounding to a corpus of human-human peer-mentoring dialogues. From this analysis, we propose effective turn-taking strategies for human-robot interaction with a teachabl…