Addressing Slot-Value Changes in Task-oriented Dialogue Systems through Dialogue Domain Adaptation
Recent task-oriented dialogue systems learn a model from annotated dialogues, and such dialogues are in turn collected and annotated so that they are consistent with certain domain knowledge. However, in real scenarios, domain knowledge is subject to frequent changes, and initial training dialogues may soon become obsolete, resulting in a significant decrease in the model performance. In this paper, we investigate the relationship between training dialogues and domain knowledge, and propose Dialogue Domain Adaptation, a methodology aiming at adapting initial training dialogues to changes intervened in the domain knowledge. We focus on slot-value changes (e.g., when new slot values are available to describe domain entities) and define an experimental setting for dialogue domain adaptation. First, we show that current state-of-the-art models for dialogue state tracking are still poorly robust to slot-value changes of the domain knowledge. Then, we compare different domain adaptation strategies, showing that simple techniques are effective to reduce the gap between training dialogues and domain knowledge.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue State TrackingDomain AdaptationTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
Multi-Domain Dialogue State Tracking with Top-K Slot Self Attention
As an important component of task-oriented dialogue systems, dialogue state tracking is designed to track the dialogue state through the conversations between users and systems. Multi-domain dialogue state tracking is a …
Dialogue State TrackingMulti-domain Dialogue State TrackingTask-Oriented Dialogue SystemsOn Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools
Dialogue state tracking (DST) is a component of the task-oriented dialogue system. It is responsible for extracting and managing slot values according to dialogue utterances, where each slot represents an essential part …
Dialogue State TrackingImproving Robustness of Task Oriented Dialog Systems
Task oriented language understanding in dialog systems is often modeled using intents (task of a query) and slots (parameters for that task). Intent detection and slot tagging are, in turn, modeled using sentence classif…
Adversarial AttackData AugmentationIntent DetectionSentence+2Transforming Slot Schema Induction with Generative Dialogue State Inference
The challenge of defining a slot schema to represent the state of a task-oriented dialogue system is addressed by Slot Schema Induction (SSI), which aims to automatically induce slots from unlabeled dialogue data. Wherea…
Elastic CRFs for Open-ontology Slot Filling
Slot filling is a crucial component in task-oriented dialog systems that is used to parse (user) utterances into semantic concepts called slots. An ontology is defined by the collection of slots and the values that each …
slot-fillingSlot Filling