KNN-Contrastive Learning for Out-of-Domain Intent Classification
The Out-of-Domain (OOD) intent classification is a basic and challenging task for dialogue systems. Previous methods commonly restrict the region (in feature space) of In-domain (IND) intent features to be compact or simply-connected implicitly, which assumes no OOD intents reside, to learn discriminative semantic features. Then the distribution of the IND intent features is often assumed to obey a hypothetical distribution (Gaussian mostly) and samples outside this distribution are regarded as OOD samples. In this paper, we start from the nature of OOD intent classification and explore its optimization objective. We further propose a simple yet effective method, named KNN-contrastive learning. Our approach utilizes k-nearest neighbors (KNN) of IND intents to learn discriminative semantic features that are more conducive to OOD detection.Notably, the density-based novelty detection algorithm is so well-grounded in the essence of our method that it is reasonable to use it as the OOD detection algorithm without making any requirements for the feature distribution.Extensive experiments on four public datasets show that our approach can not only enhance the OOD detection performance substantially but also improve the IND intent classification while requiring no restrictions on feature distribution.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationContrastive Learningintent-classificationIntent ClassificationNovelty DetectionOut of Distribution (OOD) DetectionSimilar Papers 제목 키워드 기반
Intent-Aware Dialogue Generation and Multi-Task Contrastive Learning for Multi-Turn Intent Classification
Generating large-scale, domain-specific, multilingual multi-turn dialogue datasets remains a significant hurdle for training effective Multi-Turn Intent Classification models in chatbot systems. In this paper, we introdu…
ChatbotClassificationContrastive LearningDialogue Generation+2One Stone, Four Birds: A Comprehensive Solution for QA System Using Supervised Contrastive Learning
This paper presents a novel and comprehensive solution to enhance both the robustness and efficiency of question answering (QA) systems through supervised contrastive learning (SCL). Training a high-performance QA system…
Continual LearningContrastive Learningintent-classificationIntent Classification+4Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary
Open intent classification, which aims to correctly classify the known intents into their corresponding classes while identifying the new unknown (open) intents, is an essential but challenging task in dialogue systems. …
Contrastive Learningintent-classificationIntent ClassificationAdversarial Self-Supervised Learning for Out-of-Domain Detection
Detecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while super…
Contrastive LearningOut of Distribution (OOD) DetectionSelf-Supervised LearningPseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery
New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stag…
ClusteringContrastive LearningIntent DiscoveryOpen Intent Discovery+3