paper-with-me

홈 › Papers

KNN-Contrastive Learning for Out-of-Domain Intent Classification

2022-05-01 · ACL 2022 5 · Yunhua Zhou, Peiju Liu, Xipeng Qiu

The Out-of-Domain (OOD) intent classification is a basic and challenging task for dialogue systems. Previous methods commonly restrict the region (in feature space) of In-domain (IND) intent features to be compact or simply-connected implicitly, which assumes no OOD intents reside, to learn discriminative semantic features. Then the distribution of the IND intent features is often assumed to obey a hypothetical distribution (Gaussian mostly) and samples outside this distribution are regarded as OOD samples. In this paper, we start from the nature of OOD intent classification and explore its optimization objective. We further propose a simple yet effective method, named KNN-contrastive learning. Our approach utilizes k-nearest neighbors (KNN) of IND intents to learn discriminative semantic features that are more conducive to OOD detection.Notably, the density-based novelty detection algorithm is so well-grounded in the essence of our method that it is reasonable to use it as the OOD detection algorithm without making any requirements for the feature distribution.Extensive experiments on four public datasets show that our approach can not only enhance the OOD detection performance substantially but also improve the IND intent classification while requiring no restrictions on feature distribution.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationContrastive Learningintent-classificationIntent ClassificationNovelty DetectionOut of Distribution (OOD) Detection

Similar Papers 제목 키워드 기반

Intent-Aware Dialogue Generation and Multi-Task Contrastive Learning for Multi-Turn Intent Classification

2024-11-21 · Junhua Liu, Yong Keat Tan, Bin Fu, Kwan Hui Lim

Generating large-scale, domain-specific, multilingual multi-turn dialogue datasets remains a significant hurdle for training effective Multi-Turn Intent Classification models in chatbot systems. In this paper, we introdu…

ChatbotClassificationContrastive LearningDialogue Generation+2

One Stone, Four Birds: A Comprehensive Solution for QA System Using Supervised Contrastive Learning

2024-07-12 · Bo wang, Tsunenori Mine

This paper presents a novel and comprehensive solution to enhance both the robustness and efficiency of question answering (QA) systems through supervised contrastive learning (SCL). Training a high-performance QA system…

Continual LearningContrastive Learningintent-classificationIntent Classification+4

Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary

2023-04-20 · Xiaokang Liu, Jianquan Li, Jingjing Mu, Min Yang 외

Open intent classification, which aims to correctly classify the known intents into their corresponding classes while identifying the new unknown (open) intents, is an essential but challenging task in dialogue systems. …

Contrastive Learningintent-classificationIntent Classification

Adversarial Self-Supervised Learning for Out-of-Domain Detection

2021-06-01 · NAACL 2021 4 · Zhiyuan Zeng, Keqing He, Yuanmeng Yan, Hong Xu 외

Detecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while super…

Contrastive LearningOut of Distribution (OOD) DetectionSelf-Supervised Learning

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery

2024-10-26 · Yimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu 외

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stag…

ClusteringContrastive LearningIntent DiscoveryOpen Intent Discovery+3