From Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gap
Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing approaches generally require some dialogue data with state information and their ability to generalize to unknown domains is limited. In this paper, we propose using machine reading comprehension (RC) in state tracking from two perspectives: model architectures and datasets. We divide the slot types in dialogue state into categorical or extractive to borrow the advantages from both multiple-choice and span-based reading comprehension models. Our method achieves near the current state-of-the-art in joint goal accuracy on MultiWOZ 2.1 given full training data. More importantly, by leveraging machine reading comprehension datasets, our method outperforms the existing approaches by many a large margin in few-shot scenarios when the availability of in-domain data is limited. Lastly, even without any state tracking data, i.e., zero-shot scenario, our proposed approach achieves greater than 90% average slot accuracy in 12 out of 30 slots in MultiWOZ 2.1.
Code (1)
Tasks
Dialogue State TrackingMachine Reading ComprehensionMultiple-choiceReading ComprehensionTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classification
This paper describes our approach in DSTC 8 Track 4: Schema-Guided Dialogue State Tracking. The goal of this task is to predict the intents and slots in each user turn to complete the dialogue state tracking (DST) based …
Dialogue State TrackingGeneral ClassificationMachine Reading ComprehensionReading ComprehensionAct-Aware Slot-Value Predicting in Multi-Domain Dialogue State Tracking
As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogu…
Dialogue State TrackingMachine Reading ComprehensionMulti-domain Dialogue State TrackingReading Comprehension+1SF-DST: Few-Shot Self-Feeding Reading Comprehension Dialogue State Tracking with Auxiliary Task
Few-shot dialogue state tracking (DST) model tracks user requests in dialogue with reliable accuracy even with a small amount of data. In this paper, we introduce an ontology-free few-shot DST with self-feeding belief st…
Dialogue State TrackingReading ComprehensionDREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension
We present DREAM, the first dialogue-based multiple-choice reading comprehension dataset. Collected from English-as-a-foreign-language examinations designed by human experts to evaluate the comprehension level of Chinese…
Dialogue UnderstandingMultiple-choiceReading ComprehensionSentence+1DREAM: A Challenge Data Set and Models for Dialogue-Based Reading Comprehension
We present DREAM, the first dialogue-based multiple-choice reading comprehension data set. Collected from English as a Foreign Language examinations designed by human experts to evaluate the comprehension level of Chines…
Dialogue UnderstandingMultiple-choiceReading ComprehensionSentence+1