paper-with-me

Papers

Multi-Domain Adversarial Learning for Slot Filling in Spoken Language Understanding

2017-11-30 · Bing Liu, Ian Lane

The goal of this paper is to learn cross-domain representations for slot filling task in spoken language understanding (SLU). Most of the recently published SLU models are domain-specific ones that work on individual task domains. Annotating data for each individual task domain is both financially costly and non-scalable. In this work, we propose an adversarial training method in learning common features and representations that can be shared across multiple domains. Model that produces such shared representations can be combined with models trained on individual domain SLU data to reduce the amount of training samples required for developing a new domain. In our experiments using data sets from multiple domains, we show that adversarial training helps in learning better domain-general SLU models, leading to improved slot filling F1 scores. We further show that applying adversarial learning on domain-general model also helps in achieving higher slot filling performance when the model is jointly optimized with domain-specific models.

📄 PDF Abstract BibTeX arXiv:1711.11310

Code (0)

등록된 구현이 없습니다.

Tasks

slot-fillingSlot FillingSpoken Language Understanding

Similar Papers 제목 키워드 기반

The impact of domain-specific representations on BERT-based multi-domain spoken language understanding

2021-04-01 · EACL (AdaptNLP) 2021 4 · Judith Gaspers, Quynh Do, Tobias Röding, Melanie Bradford

This paper provides the first experimental study on the impact of using domain-specific representations on a BERT-based multi-task spoken language understanding (SLU) model for multi-domain applications. Our results on a…

Classificationdomain classificationintent-classificationIntent Classification+4

A Two-stage Model for Slot Filling in Low-resource Settings: Domain-agnostic Non-slot Reduction and Pretrained Contextual Embeddings

2020-11-01 · EMNLP (sustainlp) 2020 11 · Cennet Oguz, Ngoc Thang Vu

Learning-based slot filling - a key component of spoken language understanding systems - typically requires a large amount of in-domain hand-labeled data for training. In this paper, we propose a novel two-stage model ar…

slot-fillingSlot FillingSpoken Language Understanding

Contrastive Zero-Shot Learning for Cross-Domain Slot Filling with Adversarial Attack

2020-12-01 · COLING 2020 8 · Keqing He, Jinchao Zhang, Yuanmeng Yan, Weiran Xu 외

Zero-shot slot filling has widely arisen to cope with data scarcity in target domains. However, previous approaches often ignore constraints between slot value representation and related slot description representation i…

Adversarial Attackslot-fillingSlot FillingZero-Shot Learning+1

Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention

2018-07-01 · ACL 2018 7 · Lin Zhao, Zhe Feng

We present a generative neural network model for slot filling based on a sequence-to-sequence (Seq2Seq) model together with a pointer network, in the situation where only sentence-level slot annotations are available in …

Sentenceslot-fillingSlot FillingSpeech Recognition+1

Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks

2021-06-01 · NAACL 2021 4 · Jie Wu, Ian Harris, Hongzhi Zhao

Spoken language understanding, usually including intent detection and slot filling, is a core component to build a spoken dialog system. Recent research shows promising results by jointly learning of those two tasks base…

Decoderglobal-optimizationIntent Detectionslot-filling+3