All Labels Together: Low-shot Intent Detection with an Efficient Label Semantic Encoding Paradigm
In intent detection tasks, leveraging meaningful semantic information from intent labels can be particularly beneficial for few-shot scenarios. However, existing few-shot intent detection methods either ignore the intent labels, (e.g. treating intents as indices) or do not fully utilize this information (e.g. only using part of the intent labels). In this work, we present an end-to-end One-to-All system that enables the comparison of an input utterance with all label candidates. The system can then fully utilize label semantics in this way. Experiments on three few-shot intent detection tasks demonstrate that One-to-All is especially effective when the training resource is extremely scarce, achieving state-of-the-art performance in 1-, 3- and 5-shot settings. Moreover, we present a novel pretraining strategy for our model that utilizes indirect supervision from paraphrasing, enabling zero-shot cross-domain generalization on intent detection tasks. Our code is at https://github.com/jiangshdd/AllLablesTogether.
Code (0)
등록된 구현이 없습니다.
Tasks
AllDomain GeneralizationIntent DetectionSimilar Papers 제목 키워드 기반
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning
In this work, we focus on a more challenging few-shot intent detection scenario where many intents are fine-grained and semantically similar. We present a simple yet effective few-shot intent detection schema via contras…
Contrastive LearningIntent DetectionA Label-Aware BERT Attention Network for Zero-Shot Multi-Intent Detection in Spoken Language Understanding
With the early success of query-answer assistants such as Alexa and Siri, research attempts to expand system capabilities of handling service automation are now abundant. However, preliminary systems have quickly found t…
Intent DetectionSpoken Language UnderstandingExploring the Limits of Natural Language Inference Based Setup for Few-Shot Intent Detection
Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realist…
Few-Shot LearningGeneralized Few-Shot LearningGoal-Oriented DialogIntent Detection+3Few-shot Learning for Multi-label Intent Detection
In this paper, we study the few-shot multi-label classification for user intent detection. For multi-label intent detection, state-of-the-art work estimates label-instance relevance scores and uses a threshold to select …
Few-Shot LearningIntent DetectionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONFew-shot Pseudo-Labeling for Intent Detection
In this paper, we introduce a state-of-the-art pseudo-labeling technique for few-shot intent detection. We devise a folding/unfolding hierarchical clustering algorithm which assigns weighted pseudo-labels to unlabeled us…
ClusteringIntent Detectiontext-classificationText Classification