Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?
Task-oriented dialogue (TOD) systems have assisted users on many tasks, including ticket booking and service inquiries. While existing TOD systems have shown promising performance in serving customer needs, these systems mostly assume that users would interact with the dialogue agent politely. This assumption is unrealistic as impatient or frustrated customers may also interact with TOD systems impolitely. This paper aims to address this research gap by investigating impolite users' effects on TOD systems. Specifically, we constructed an impolite dialogue corpus and conducted extensive experiments to evaluate the state-of-the-art TOD systems on our impolite dialogue corpus. Our experimental results show that existing TOD systems are unable to handle impolite user utterances. We also present a data augmentation method to improve TOD performance in impolite dialogues. Nevertheless, handling impolite dialogues remains a very challenging research task. We hope by releasing the impolite dialogue corpus and establishing the benchmark evaluations, more researchers are encouraged to investigate this new challenging research task.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationTask-Oriented Dialogue SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues
With the advances in deep learning, tremendous progress has been made with chit-chat dialogue systems and task-oriented dialogue systems. However, these two systems are often tackled separately in current methods. To ach…
Task-Oriented Dialogue SystemsDORA: Toward Policy Optimization for Task-oriented Dialogue System with Efficient Context
Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented d…
Reinforcement Learning (RL)Task-Oriented Dialogue SystemsPrecognition in Task-oriented Dialogue Understanding: Posterior Regularization by Future Context
Task-oriented dialogue systems have become overwhelmingly popular in recent researches. Dialogue understanding is widely used to comprehend users' intent, emotion and dialogue state in task-oriented dialogue systems. Mos…
Dialogue UnderstandingTask-Oriented Dialogue SystemsViWOZ: A Multi-Domain Task-Oriented Dialogue Systems Dataset For Low-resource Language
Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is st…
Task-Oriented Dialogue SystemsHelpfulness and Fairness of Task-Oriented Dialogue Systems
Goal-oriented dialogue systems aim to help users achieve certain goals. Therefore, how humans perceive their helpfulness is important. However, neither the human-perceived helpfulness of goal-oriented dialogue systems no…
FairnessGoal-Oriented Dialogue SystemsTask-Oriented Dialogue Systems