Domain Adaptation of Recurrent Neural Networks for Natural Language Understanding
The goal of this paper is to use multi-task learning to efficiently scale slot filling models for natural language understanding to handle multiple target tasks or domains. The key to scalability is reducing the amount of training data needed to learn a model for a new task. The proposed multi-task model delivers better performance with less data by leveraging patterns that it learns from the other tasks. The approach supports an open vocabulary, which allows the models to generalize to unseen words, which is particularly important when very little training data is used. A newly collected crowd-sourced data set, covering four different domains, is used to demonstrate the effectiveness of the domain adaptation and open vocabulary techniques.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMulti-Task LearningNatural Language Understandingslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
Fast Gated Neural Domain Adaptation: Language Model as a Case Study
Neural network training has been shown to be advantageous in many natural language processing applications, such as language modelling or machine translation. In this paper, we describe in detail a novel domain adaptatio…
Domain AdaptationLanguage ModelingLanguage ModellingMachine Translation+1Multi-domain Neural Network Language Generation for Spoken Dialogue Systems
Moving from limited-domain natural language generation (NLG) to open domain is difficult because the number of semantic input combinations grows exponentially with the number of domains. Therefore, it is important to lev…
Domain AdaptationSpoken Dialogue SystemsText GenerationBuilding and Learning Structures in a Situated Blocks World Through Deep Language Understanding
We demonstrate a system for understanding natural language utterances for structure description and placement in a situated blocks world context. By relying on a rich, domain-specific adaptation of a generic ontology and…
Progressive Memory Banks for Incremental Domain Adaptation
This paper addresses the problem of incremental domain adaptation (IDA) in natural language processing (NLP). We assume each domain comes one after another, and that we could only access data in the current domain. The g…
Domain AdaptationEnd-to-End Joint Learning of Natural Language Understanding and Dialogue Manager
Natural language understanding and dialogue policy learning are both essential in conversational systems that predict the next system actions in response to a current user utterance. Conventional approaches aggregate sep…
Natural Language Understanding