paper-with-me

Papers

SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling

2021-08-26 · Fengyu Cai, Wanhao Zhou, Fei Mi, Boi Faltings

Utterance-level intent detection and token-level slot filling are two key tasks for natural language understanding (NLU) in task-oriented systems. Most existing approaches assume that only a single intent exists in an utterance. However, there are often multiple intents within an utterance in real-life scenarios. In this paper, we propose a multi-intent NLU framework, called SLIM, to jointly learn multi-intent detection and slot filling based on BERT. To fully exploit the existing annotation data and capture the interactions between slots and intents, SLIM introduces an explicit slot-intent classifier to learn the many-to-one mapping between slots and intents. Empirical results on three public multi-intent datasets demonstrate (1) the superior performance of SLIM compared to the current state-of-the-art for NLU with multiple intents and (2) the benefits obtained from the slot-intent classifier.

📄 PDF Abstract BibTeX arXiv:2108.11711

Code (1)

TRUMANCFY/SLIM 공식 구현 pytorch

Tasks

Intent DetectionNatural Language UnderstandingSemantic Frame Parsingslot-fillingSlot Filling

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Intent Detection and Slot Filling for Vietnamese

2021-04-05 · Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen

Intent detection and slot filling are important tasks in spoken and natural language understanding. However, Vietnamese is a low-resource language in these research topics. In this paper, we present the first public inte…

Intent Classification and Slot FillingIntent DetectionNatural Language Understandingslot-filling+1

ESIE-BERT: Enriching Sub-words Information Explicitly with BERT for Joint Intent Classification and SlotFilling

2022-11-27 · Yu Guo, Zhilong Xie, Xingyan Chen, Huangen Chen 외

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising s…

intent-classificationIntent ClassificationIntent Classification and Slot FillingNatural Language Understanding+3

BERT for Joint Intent Classification and Slot Filling

2019-02-28 · Qian Chen, Zhu Zhuo, Wen Wang

Intent classification and slot filling are two essential tasks for natural language understanding. They often suffer from small-scale human-labeled training data, resulting in poor generalization capability, especially f…

General Classificationintent-classificationIntent ClassificationIntent Detection+3

Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT

2022-05-19 · Shruthi Hariharan, Vignesh Kumar Krishnamurthy, Utkarsh, Jayantha Gowda Sarapanahalli

Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent…

Intent DetectionNatural Language Understanding

Task Conditioned BERT for Joint Intent Detection and Slot-filling

2023-08-11 · Diogo Tavares, Pedro Azevedo, David Semedo, Ricardo Sousa 외

Dialogue systems need to deal with the unpredictability of user intents to track dialogue state and the heterogeneity of slots to understand user preferences. In this paper we investigate the hypothesis that solving thes…

Intent Detectionslot-fillingSlot Filling