The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics
Dialogue breakdown detection is a promising technique in dialogue systems. To promote the research and development of such a technique, we organized a dialogue breakdown detection challenge where the task is to detect a system{'}s inappropriate utterances that lead to dialogue breakdowns in chat. This paper describes the design, datasets, and evaluation metrics for the challenge as well as the methods and results of the submitted runs of the participants.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Improving Dialogue Breakdown Detection with Semi-Supervised Learning
Building user trust in dialogue agents requires smooth and consistent dialogue exchanges. However, agents can easily lose conversational context and generate irrelevant utterances. These situations are called dialogue br…
Data AugmentationA Co-Attentive Cross-Lingual Neural Model for Dialogue Breakdown Detection
Ensuring smooth communication is essential in a chat-oriented dialogue system, so that a user can obtain meaningful responses through interactions with the system. Most prior work on dialogue research does not focus on p…
Language ModelingLanguage ModellingWord EmbeddingsTeam Irisapu Project Description for DRC2023
This paper describes the dialog robot system designed by Team Irisapu for the preliminary round of the Dialogue Robot Competition 2023 (DRC2023). In order to generate dialogue responses flexibly while adhering to predete…
Dialogue Act-based Breakdown Detection in Negotiation Dialogues
Thanks to the success of goal-oriented negotiation dialogue systems, studies of negotiation dialogue have gained momentum in terms of both human-human negotiation support and dialogue systems. However, the field suffers …
Multimodal Contextual Dialogue Breakdown Detection for Conversational AI Models
Detecting dialogue breakdown in real time is critical for conversational AI systems, because it enables taking corrective action to successfully complete a task. In spoken dialog systems, this breakdown can be caused by …
Navigate