paper-with-me

홈 › Papers

Zero-Shot Learning for Joint Intent and Slot Labeling

2022-11-29 · Rashmi Gangadharaiah, Balakrishnan Narayanaswamy

It is expensive and difficult to obtain the large number of sentence-level intent and token-level slot label annotations required to train neural network (NN)-based Natural Language Understanding (NLU) components of task-oriented dialog systems, especially for the many real world tasks that have a large and growing number of intents and slot types. While zero shot learning approaches that require no labeled examples -- only features and auxiliary information -- have been proposed only for slot labeling, we show that one can profitably perform joint zero-shot intent classification and slot labeling. We demonstrate the value of capturing dependencies between intents and slots, and between different slots in an utterance in the zero shot setting. We describe NN architectures that translate between word and sentence embedding spaces, and demonstrate that these modifications are required to enable zero shot learning for this task. We show a substantial improvement over strong baselines and explain the intuition behind each architectural modification through visualizations and ablation studies.

📄 PDF Abstract BibTeX arXiv:2212.07922

Code (0)

등록된 구현이 없습니다.

Tasks

intent-classificationIntent ClassificationNatural Language UnderstandingSentenceSentence EmbeddingSentence-EmbeddingZero-Shot Intent ClassificationZero-Shot Learning

Similar Papers 제목 키워드 기반

Augmented Natural Language for Generative Sequence Labeling

2020-09-15 · EMNLP 2020 11 · Ben Athiwaratkun, Cicero Nogueira dos santos, Jason Krone, Bing Xiang

We propose a generative framework for joint sequence labeling and sentence-level classification. Our model performs multiple sequence labeling tasks at once using a single, shared natural language output space. Unlike pr…

intent-classificationIntent Classificationnamed-entity-recognitionNamed Entity Recognition+2

Fine-Tuning BERT for Schema-Guided Zero-Shot Dialogue State Tracking

2020-02-01 · Yu-Ping Ruan, Zhen-Hua Ling, Jia-Chen Gu, Quan Liu

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize …

Dialogue State TrackingNatural Language UnderstandingPredictionslot-filling+2

Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling

2021-05-25 · Findings (ACL) 2021 8 · Yutai Hou, Yongkui Lai, Cheng Chen, Wanxiang Che 외

In this paper, we investigate few-shot joint learning for dialogue language understanding. Most existing few-shot models learn a single task each time with only a few examples. However, dialogue language understanding co…

Few-Shot LearningIntent Detectionslot-fillingSlot Filling

Joint Multiple Intent Detection and Slot Labeling for Goal-Oriented Dialog

2019-06-01 · NAACL 2019 6 · Rashmi Gangadharaiah, Balakrishnan Narayanaswamy

Neural network models have recently gained traction for sentence-level intent classification and token-based slot-label identification. In many real-world scenarios, users have multiple intents in the same utterance, and…

General ClassificationGoal-Oriented Dialogintent-classificationIntent Classification+4

I$^2$KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding

2023-10-04 · Tianjun Mao, Chenghong Zhang

Spoken language understanding (SLU) typically includes two subtasks: intent detection and slot filling. Currently, it has achieved great success in high-resource languages, but it still remains challenging in low-resourc…

Intent DetectionKnowledge Distillationslot-fillingSlot Filling+1