End-to-End Neural Pipeline for Goal-Oriented Dialogue Systems using GPT-2
The goal-oriented dialogue system needs to be optimized for tracking the dialogue flow and carrying out an effective conversation under various situations to meet the user goal. The traditional approach to build such a dialogue system is to take a pipelined modular architecture, where its modules are optimized individually. However, such an optimization scheme does not necessarily yield the overall performance improvement of the whole system. On the other hand, end-to-end dialogue systems with monolithic neural architecture are often trained only with input-output utterances, without taking into account the entire annotations available in the corpus. This scheme makes it difficult for goal-oriented dialogues where the system needs to integrate with external systems or to provide interpretable information about why the system generated a particular response. In this paper, we present an end-to-end neural architecture for dialogue systems that addresses both challenges above. In the human evaluation, our dialogue system achieved the success rate of 68.32{\%}, the language understanding score of 4.149, and the response appropriateness score of 4.287, which ranked the system at the top position in the end-to-end multi-domain dialogue system task in the 8th dialogue systems technology challenge (DSTC8).
Code (0)
등록된 구현이 없습니다.
Tasks
Goal-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
Goal-Embedded Dual Hierarchical Model for Task-Oriented Dialogue Generation
Hierarchical neural networks are often used to model inherent structures within dialogues. For goal-oriented dialogues, these models miss a mechanism adhering to the goals and neglect the distinct conversational patterns…
Data AugmentationDecoderDialogue GenerationResponse GenerationHelpfulness and Fairness of Task-Oriented Dialogue Systems
Goal-oriented dialogue systems aim to help users achieve certain goals. Therefore, how humans perceive their helpfulness is important. However, neither the human-perceived helpfulness of goal-oriented dialogue systems no…
FairnessGoal-Oriented Dialogue SystemsTask-Oriented Dialogue SystemsCrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset
To advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dat…
Dialogue State TrackingTask-Oriented Dialogue SystemsUser SimulationDeep Learning for Conversational AI
Spoken Dialogue Systems (SDS) have great commercial potential as they promise to revolutionise the way in which humans interact with machines. The advent of deep learning led to substantial developments in this area of N…
Decision MakingDeep LearningDialogue ManagementDialogue State Tracking+4Gaining Insights into Unrecognized User Utterances in Task-Oriented Dialog Systems
The rapidly growing market demand for automatic dialogue agents capable of goal-oriented behavior has caused many tech-industry leaders to invest considerable efforts into task-oriented dialog systems. The success of the…
AttributeGoal-Oriented Dialog