Learning End-to-End Goal-Oriented Dialog with Maximal User Task Success and Minimal Human Agent Use
Neural end-to-end goal-oriented dialog systems showed promise to reduce the workload of human agents for customer service, as well as reduce wait time for users. However, their inability to handle new user behavior at deployment has limited their usage in real world. In this work, we propose an end-to-end trainable method for neural goal-oriented dialog systems which handles new user behaviors at deployment by transferring the dialog to a human agent intelligently. The proposed method has three goals: 1) maximize user's task success by transferring to human agents, 2) minimize the load on the human agents by transferring to them only when it is essential and 3) learn online from the human agent's responses to reduce human agents load further. We evaluate our proposed method on a modified-bAbI dialog task that simulates the scenario of new user behaviors occurring at test time. Experimental results show that our proposed method is effective in achieving the desired goals.
Code (1)
Tasks
Goal-Oriented DialogSimilar Papers 제목 키워드 기반
User Modeling for Task Oriented Dialogues
We introduce end-to-end neural network based models for simulating users of task-oriented dialogue systems. User simulation in dialogue systems is crucial from two different perspectives: (i) automatic evaluation of diff…
Dialogue State TrackingDiversityTask-Oriented Dialogue SystemsUser SimulationGaining Insights into Unrecognized User Utterances in Task-Oriented Dialog Systems
The rapidly growing market demand for automatic dialogue agents capable of goal-oriented behavior has caused many tech-industry leaders to invest considerable efforts into task-oriented dialog systems. The success of the…
AttributeGoal-Oriented DialogRADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user i…
DiagnosticVariational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation
Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks. In this work, we extend this approach to the ta…
Data Augmentationdialog state trackingDialogue State TrackingResponse Generation+2Helpfulness and Fairness of Task-Oriented Dialogue Systems
Goal-oriented dialogue systems aim to help users achieve certain goals. Therefore, how humans perceive their helpfulness is important. However, neither the human-perceived helpfulness of goal-oriented dialogue systems no…
FairnessGoal-Oriented Dialogue SystemsTask-Oriented Dialogue Systems