Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems
Over-dependence on domain ontology and lack of knowledge sharing across domains are two practical and yet less studied problems of dialogue state tracking. Existing approaches generally fall short in tracking unknown slot values during inference and often have difficulties in adapting to new domains. In this paper, we propose a Transferable Dialogue State Generator (TRADE) that generates dialogue states from utterances using a copy mechanism, facilitating knowledge transfer when predicting (domain, slot, value) triplets not encountered during training. Our model is composed of an utterance encoder, a slot gate, and a state generator, which are shared across domains. Empirical results demonstrate that TRADE achieves state-of-the-art joint goal accuracy of 48.62% for the five domains of MultiWOZ, a human-human dialogue dataset. In addition, we show its transferring ability by simulating zero-shot and few-shot dialogue state tracking for unseen domains. TRADE achieves 60.58% joint goal accuracy in one of the zero-shot domains, and is able to adapt to few-shot cases without forgetting already trained domains.
Code (2)
Tasks
Dialogue State TrackingMulti-domain Dialogue State TrackingTask-Oriented Dialogue SystemsTransfer LearningSimilar Papers 제목 키워드 기반
Network Architecture Search for Domain Adaptation
Deep networks have been used to learn transferable representations for domain adaptation. Existing deep domain adaptation methods systematically employ popular hand-crafted networks designed specifically for image-classi…
Domain Adaptationimage-classificationImage ClassificationNeural Architecture SearchCSCL: Critical Semantic-Consistent Learning for Unsupervised Domain Adaptation
Unsupervised domain adaptation without consuming annotation process for unlabeled target data attracts appealing interests in semantic segmentation. However, 1) existing methods neglect that not all semantic representati…
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationCLIP-Guided Generative Networks for Transferable Targeted Adversarial Attacks
Transferable targeted adversarial attacks aim to mislead models into outputting adversary-specified predictions in black-box scenarios. Recent studies have introduced \textit{single-target} generative attacks that train …
Schema Encoding for Transferable Dialogue State Tracking
Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermo…
Dialogue State TrackingTask-Oriented Dialogue SystemsTransferable Boltzmann Generators
The generation of equilibrium samples of molecular systems has been a long-standing problem in statistical physics. Boltzmann Generators are a generative machine learning method that addresses this issue by learning a tr…