It’s About Time: Turn-Entry Timing For Situated Human-Robot Dialogue
Turn-entry timing is an important requirement for conversation, and one that spoken dialogue systems largely fail at. In this paper, we introduce a computational framework based on work from Psycholinguistics, which is aimed at achieving proper turn-taking timing for situated agents. The approach involves incremental processing and lexical prediction of the turn in progress, which allows a situated dialogue system to start its turn and initiate actions earlier than would otherwise be possible. We evaluate the framework by integrating it within a cognitive robotic architecture and testing performance on a corpus of task-oriented human-robot directives. We demonstrate that: 1) the system is superior to a non-incremental system in terms of faster responses, reduced gap between turns, and the ability to perform actions early, 2) the system can time its turn to come in immediately at a transition point or earlier to produce several types of overlap, and 3) the system is robust to various forms of disfluency in the input. Overall, this domain-independent framework can be integrated into various dialogue systems to improve responsiveness, and is a step toward more natural, human-like turn-taking behavior.
Code (0)
등록된 구현이 없습니다.
Tasks
Spoken Dialogue SystemsSimilar Papers 제목 키워드 기반
Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence
We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. The framework provides infrastructure, tools, and components that enable and accelerate the development of …
Planning and Acting While the Clock Ticks
Standard temporal planning assumes that planning takes place offline and then execution starts at time 0. Recently, situated temporal planning was introduced, where planning starts at time 0 and execution occurs after pl…
Optimal Multiple Trading Times Under the Exponential OU Model with Transaction Costs
This paper studies the timing of trades under mean-reverting price dynamics subject to fixed transaction costs. We solve an optimal double stopping problem to determine the optimal times to enter and subsequently exit th…
The Mathematics of Market Timing
Market timing is an investment technique that tries to continuously switch investment into assets forecast to have better returns. What is the likelihood of having a successful market timing strategy? With an emphasis on…
MathWhere and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational Recommendation
Situated conversational recommendation (SCR), which utilizes visual scenes grounded in specific environments and natural language dialogue to deliver contextually appropriate recommendations, has emerged as a promising r…
Response Generation