Cost-Sensitive Active Learning for Dialogue State Tracking
Dialogue state tracking (DST), when formulated as a supervised learning problem, relies on labelled data. Since dialogue state annotation usually requires labelling all turns of a single dialogue and utilizing context information, it is very expensive to annotate all available unlabelled data. In this paper, a novel cost-sensitive active learning framework is proposed based on a set of new dialogue-level query strategies. This is the first attempt to apply active learning for dialogue state tracking. Experiments on DSTC2 show that active learning with mixed data query strategies can effectively achieve the same DST performance with significantly less data annotation compared to traditional training approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningDialogue State TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Turn-Level Active Learning for Dialogue State Tracking
Dialogue state tracking (DST) plays an important role in task-oriented dialogue systems. However, collecting a large amount of turn-by-turn annotated dialogue data is costly and inefficient. In this paper, we propose a n…
Active LearningDialogue State TrackingTask-Oriented Dialogue SystemsContext-Sensitive Generation Network for Handing Unknown Slot Values in Dialogue State Tracking
As a key component in a dialogue system, dialogue state tracking plays an important role. It is very important for dialogue state tracking to deal with the problem of unknown slot values. As far as we known, almost all e…
Dialogue State TrackingGrounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns
Schema-guided dialogue state trackers can generalise to new domains without further training, yet they are sensitive to the writing style of the schemata. Augmenting the training set with human or synthetic schema paraph…
SensitivityConversational Human Audio-visual Talking Dialogue Generation
Large-scale dyadic interactive audio-visual dialogue (DIAD) datasets provide fundamental data resources for developing humanoid interactive virtual agents and digital humans. However, collecting such data is time-consumi…
Dialogue GenerationAmendable Generation for Dialogue State Tracking
In task-oriented dialogue systems, recent dialogue state tracking methods tend to perform one-pass generation of the dialogue state based on the previous dialogue state. The mistakes of these models made at the current t…
Dialogue State TrackingMulti-domain Dialogue State TrackingTask-Oriented Dialogue Systems