A Closer Look at Few-Shot Out-of-Distribution Intent Detection
We consider few-shot out-of-distribution (OOD) intent detection, a practical and important problem for the development of task-oriented dialogue systems. Despite its importance, this problem is seldom studied in the literature, let alone examined in a systematic way. In this work, we take a closer look at this problem and identify key issues for research. In our pilot study, we reveal the reason why existing OOD intent detection methods are not adequate in dealing with this problem. Based on the observation, we propose a promising approach to tackle this problem based on latent representation generation and self-supervision. Comprehensive experiments on three real-world intent detection benchmark datasets demonstrate the high effectiveness of our proposed approach and its great potential in improving state-of-the-art methods for few-shot OOD intent detection.
Code (1)
Tasks
Intent DetectionTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning
In this work, we focus on a more challenging few-shot intent detection scenario where many intents are fine-grained and semantically similar. We present a simple yet effective few-shot intent detection schema via contras…
Contrastive LearningIntent DetectionA Closer Look at the Learnability of Out-of-Distribution (OOD) Detection
Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice,…
Learning TheoryOut of Distribution (OOD) DetectionPAC learningA Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
New conversation topics and functionalities are constantly being added to conversational AI agents like Amazon Alexa and Apple Siri. As data collection and annotation is not scalable and is often costly, only a handful o…
Data AugmentationGeneral Classificationintent-classificationIntent Classification+2CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection
In this paper, we formulate a more realistic and difficult problem setup for the intent detection task in natural language understanding, namely Generalized Few-Shot Intent Detection (GFSID). GFSID aims to discriminate a…
Conditional Text GenerationIntent DetectionLanguage ModelingLanguage Modelling+3Pseudo Siamese Network for Few-shot Intent Generation
Few-shot intent detection is a challenging task due to the scare annotation problem. In this paper, we propose a Pseudo Siamese Network (PSN) to generate labeled data for few-shot intents and alleviate this problem. PSN …
Intent DetectionObjectSentence