paper-with-me

홈 › Papers

A Unified Framework for Multi-intent Spoken Language Understanding with prompting

2022-10-07 · Feifan Song, Lianzhe Huang, Houfeng Wang

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current approaches are apt to formulate these two sub-tasks differently, which leads to two issues: 1) It hinders models from effective extraction of shared features. 2) Pretty complicated structures are involved to enhance expression ability while causing damage to the interpretability of frameworks. In this work, we describe a Prompt-based Spoken Language Understanding (PromptSLU) framework, to intuitively unify two sub-tasks into the same form by offering a common pre-trained Seq2Seq model. In detail, ID and SF are completed by concisely filling the utterance into task-specific prompt templates as input, and sharing output formats of key-value pairs sequence. Furthermore, variable intents are predicted first, then naturally embedded into prompts to guide slot-value pairs inference from a semantic perspective. Finally, we are inspired by prevalent multi-task learning to introduce an auxiliary sub-task, which helps to learn relationships among provided labels. Experiment results show that our framework outperforms several state-of-the-art baselines on two public datasets.

📄 PDF Abstract BibTeX arXiv:2210.03337

Code (1)

F2-Song/PromptSLU 공식 구현 pytorch

Tasks

Intent DetectionMulti-Task Learningslot-fillingSlot FillingSpoken Language Understanding

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Uni-MIS: United Multiple Intent Spoken Language Understanding via Multi-View Intent-Slot Interaction

2024-03-24 · Proceedings of the AAAI Conference on Artificial Intelligence 2024 3 · Shangjian Yin, Peijie Huang, Yuhong Xu

So far, multi-intent spoken language understanding (SLU) has become a research hotspot in the field of natural language processing (NLP) due to its ability to recognize and extract multiple intents expressed and annotate…

Intent Detectionslot-fillingSlot FillingSpoken Language Understanding

OpenSLU: A Unified, Modularized, and Extensible Toolkit for Spoken Language Understanding

2023-05-17 · Libo Qin, Qiguang Chen, Xiao Xu, Yunlong Feng 외

Spoken Language Understanding (SLU) is one of the core components of a task-oriented dialogue system, which aims to extract the semantic meaning of user queries (e.g., intents and slots). In this work, we introduce OpenS…

Spoken Language Understanding

MAC-SLU: Multi-Intent Automotive Cabin Spoken Language Understanding Benchmark

2025-12-01 · Yuezhang Peng, Chonghao Cai, Ziang Liu, Shuai Fan 외 arxiv

Spoken Language Understanding (SLU), which aims to extract user semantics to execute downstream tasks, is a crucial component of task-oriented dialog systems. Existing SLU datasets generally lack sufficient diversity and…

Spoken Language UnderstandingSpeech Recognition

An Adapter-Based Unified Model for Multiple Spoken Language Processing Tasks

2024-06-20 · Varsha Suresh, Salah Aït-Mokhtar, Caroline Brun, Ioan Calapodescu

Self-supervised learning models have revolutionized the field of speech processing. However, the process of fine-tuning these models on downstream tasks requires substantial computational resources, particularly when dea…

Automatic Speech RecognitionDecoderEmotion Recognitionintent-classification+7

Incorporating Instructional Prompts into a Unified Generative Framework for Joint Multiple Intent Detection and Slot Filling

2022-10-01 · COLING 2022 10 · Yangjun Wu, Han Wang, Dongxiang Zhang, Gang Chen 외

The joint multiple Intent Detection (ID) and Slot Filling (SF) is a significant challenge in spoken language understanding. Because the slots in an utterance may relate to multi-intents, most existing approaches focus on…

Intent DetectionSemantic Frame Parsingslot-fillingSlot Filling+1