A Student-Teacher Architecture for Dialog Domain Adaptation under the Meta-Learning Setting
Numerous new dialog domains are being created every day while collecting data for these domains is extremely costly since it involves human interactions. Therefore, it is essential to develop algorithms that can adapt to different domains efficiently when building data-driven dialog models. The most recent researches on domain adaption focus on giving the model a better initialization, rather than optimizing the adaptation process. We propose an efficient domain adaptive task-oriented dialog system model, which incorporates a meta-teacher model to emphasize the different impacts between generated tokens with respect to the context. We first train our base dialog model and meta-teacher model adversarially in a meta-learning setting on rich-resource domains. The meta-teacher learns to quantify the importance of tokens under different contexts across different domains. During adaptation, the meta-teacher guides the dialog model to focus on important tokens in order to achieve better adaptation efficiency. We evaluate our model on two multi-domain datasets, MultiWOZ and Google Schema-Guided Dialogue, and achieve state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMeta-LearningSimilar Papers 제목 키워드 기반
MTSS: Learn from Multiple Domain Teachers and Become a Multi-domain Dialogue Expert
How to build a high-quality multi-domain dialogue system is a challenging work due to its complicated and entangled dialogue state space among each domain, which seriously limits the quality of dialogue policy, and furth…
Teacher-Student Framework Enhanced Multi-domain Dialogue Generation
Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply …
Dialogue GenerationSimple Data Augmentation with the Mask Token Improves Domain Adaptation for Dialog Act Tagging
The concept of Dialogue Act (DA) is universal across different task-oriented dialogue domains - the act of {``}request{''} carries the same speaker intention whether it is for restaurant reservation or flight booking. Ho…
Data AugmentationDomain AdaptationDomain GeneralizationTeacher-Student Competition for Unsupervised Domain Adaptation
With the supervision from source domain only in class-level, existing unsupervised domain adaptation (UDA) methods mainly learn the domain-invariant representations from a shared feature extractor, which causes the sourc…
Domain AdaptationUnsupervised Domain AdaptationProgressive unsupervised domain adaptation for ASR using ensemble models and multi-stage training
In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain Adaptationspeech-recognition+2