Multi-Domain Spoken Language Understanding Using Domain- and Task-Aware Parameterization
Spoken language understanding has been addressed as a supervised learning problem, where a set of training data is available for each domain. However, annotating data for each domain is both financially costly and non-scalable so we should fully utilize information across all domains. One existing approach solves the problem by conducting multi-domain learning, using shared parameters for joint training across domains. We propose to improve the parameterization of this method by using domain-specific and task-specific model parameters to improve knowledge learning and transfer. Experiments on 5 domains show that our model is more effective for multi-domain SLU and obtain the best results. In addition, we show its transferability by outperforming the prior best model by 12.4\% when adapting to a new domain with little data.
Code (0)
등록된 구현이 없습니다.
Tasks
Spoken Language UnderstandingSimilar Papers 제목 키워드 기반
The impact of domain-specific representations on BERT-based multi-domain spoken language understanding
This paper provides the first experimental study on the impact of using domain-specific representations on a BERT-based multi-task spoken language understanding (SLU) model for multi-domain applications. Our results on a…
Classificationdomain classificationintent-classificationIntent Classification+4Transferring SLU Models in Novel Domains
Spoken language understanding (SLU) is a critical component in building dialogue systems. When building models for novel natural language domains, a major challenge is the lack of data in the new domains, no matter wheth…
Intent RecognitionMeta-Learningslot-fillingSlot Filling+2An Arabic Multi-Domain Spoken Language Understanding System
Locale-agnostic Universal Domain Classification Model in Spoken Language Understanding
In this paper, we introduce an approach for leveraging available data across multiple locales sharing the same language to 1) improve domain classification model accuracy in Spoken Language Understanding and user experie…
Classificationdomain classificationGeneral ClassificationMulti-Task Learning+1The Alexa Meaning Representation Language
This paper introduces a meaning representation for spoken language understanding. The Alexa meaning representation language (AMRL), unlike previous approaches, which factor spoken utterances into domains, provides a comm…
Spoken Language Understanding