paper-with-me

홈 › Papers

A Student-Teacher Architecture for Dialog Domain Adaptation under the Meta-Learning Setting

2021-04-06 · Kun Qian, Wei Wei, Zhou Yu

Numerous new dialog domains are being created every day while collecting data for these domains is extremely costly since it involves human interactions. Therefore, it is essential to develop algorithms that can adapt to different domains efficiently when building data-driven dialog models. The most recent researches on domain adaption focus on giving the model a better initialization, rather than optimizing the adaptation process. We propose an efficient domain adaptive task-oriented dialog system model, which incorporates a meta-teacher model to emphasize the different impacts between generated tokens with respect to the context. We first train our base dialog model and meta-teacher model adversarially in a meta-learning setting on rich-resource domains. The meta-teacher learns to quantify the importance of tokens under different contexts across different domains. During adaptation, the meta-teacher guides the dialog model to focus on important tokens in order to achieve better adaptation efficiency. We evaluate our model on two multi-domain datasets, MultiWOZ and Google Schema-Guided Dialogue, and achieve state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2104.02689

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationMeta-Learning

Similar Papers 제목 키워드 기반

MTSS: Learn from Multiple Domain Teachers and Become a Multi-domain Dialogue Expert

2020-05-21 · Shuke Peng, Feng Ji, Zehao Lin, Shaobo Cui 외

How to build a high-quality multi-domain dialogue system is a challenging work due to its complicated and entangled dialogue state space among each domain, which seriously limits the quality of dialogue policy, and furth…

Teacher-Student Framework Enhanced Multi-domain Dialogue Generation

2019-08-20 · Shuke Peng, Xinjing Huang, Zehao Lin, Feng Ji 외

Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply …

Dialogue Generation

Simple Data Augmentation with the Mask Token Improves Domain Adaptation for Dialog Act Tagging

2020-11-01 · EMNLP 2020 11 · Semih Yavuz, Kazuma Hashimoto, Wenhao Liu, Nitish Shirish Keskar 외

The concept of Dialogue Act (DA) is universal across different task-oriented dialogue domains - the act of {``}request{''} carries the same speaker intention whether it is for restaurant reservation or flight booking. Ho…

Data AugmentationDomain AdaptationDomain Generalization

Teacher-Student Competition for Unsupervised Domain Adaptation

2020-10-19 · Ruixin Xiao, Zhilei Liu, Baoyuan Wu

With the supervision from source domain only in class-level, existing unsupervised domain adaptation (UDA) methods mainly learn the domain-invariant representations from a shared feature extractor, which causes the sourc…

Domain AdaptationUnsupervised Domain Adaptation

Progressive unsupervised domain adaptation for ASR using ensemble models and multi-stage training

2024-02-07 · Rehan Ahmad, Muhammad Umar Farooq, Thomas Hain

In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain Adaptationspeech-recognition+2