paper-with-me

홈 › Papers

Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?

2022-10-24 · Zhiqiang Hu, Roy Kaa-Wei Lee, Nancy F. Chen

Task-oriented dialogue (TOD) systems have assisted users on many tasks, including ticket booking and service inquiries. While existing TOD systems have shown promising performance in serving customer needs, these systems mostly assume that users would interact with the dialogue agent politely. This assumption is unrealistic as impatient or frustrated customers may also interact with TOD systems impolitely. This paper aims to address this research gap by investigating impolite users' effects on TOD systems. Specifically, we constructed an impolite dialogue corpus and conducted extensive experiments to evaluate the state-of-the-art TOD systems on our impolite dialogue corpus. Our experimental results show that existing TOD systems are unable to handle impolite user utterances. We also present a data augmentation method to improve TOD performance in impolite dialogues. Nevertheless, handling impolite dialogues remains a very challenging research task. We hope by releasing the impolite dialogue corpus and establishing the benchmark evaluations, more researchers are encouraged to investigate this new challenging research task.

📄 PDF Abstract BibTeX arXiv:2210.12942

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues

2021-10-15 · dialdoc (ACL) 2022 5 · Xinyan Zhao, Bin He, Yasheng Wang, Yitong Li 외

With the advances in deep learning, tremendous progress has been made with chit-chat dialogue systems and task-oriented dialogue systems. However, these two systems are often tackled separately in current methods. To ach…

Task-Oriented Dialogue Systems

DORA: Toward Policy Optimization for Task-oriented Dialogue System with Efficient Context

2021-07-07 · Hyunmin Jeon, Gary Geunbae Lee

Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented d…

Reinforcement Learning (RL)Task-Oriented Dialogue Systems

Precognition in Task-oriented Dialogue Understanding: Posterior Regularization by Future Context

2022-03-07 · Nan Su, Yuchi Zhang, Chao Liu, Bingzhu Du 외

Task-oriented dialogue systems have become overwhelmingly popular in recent researches. Dialogue understanding is widely used to comprehend users' intent, emotion and dialogue state in task-oriented dialogue systems. Mos…

Dialogue UnderstandingTask-Oriented Dialogue Systems

ViWOZ: A Multi-Domain Task-Oriented Dialogue Systems Dataset For Low-resource Language

2022-03-15 · Phi Nguyen Van, Tung Cao Hoang, Dung Nguyen Manh, Quan Nguyen Minh 외

Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is st…

Task-Oriented Dialogue Systems

Helpfulness and Fairness of Task-Oriented Dialogue Systems

2022-05-25 · Jiao Sun, Yu Hou, Jiin Kim, Nanyun Peng

Goal-oriented dialogue systems aim to help users achieve certain goals. Therefore, how humans perceive their helpfulness is important. However, neither the human-perceived helpfulness of goal-oriented dialogue systems no…

FairnessGoal-Oriented Dialogue SystemsTask-Oriented Dialogue Systems