Deep Open Intent Classification with Adaptive Decision Boundary
Open intent classification is a challenging task in dialogue systems. On the one hand, it should ensure the quality of known intent identification. On the other hand, it needs to detect the open (unknown) intent without prior knowledge. Current models are limited in finding the appropriate decision boundary to balance the performances of both known intents and the open intent. In this paper, we propose a post-processing method to learn the adaptive decision boundary (ADB) for open intent classification. We first utilize the labeled known intent samples to pre-train the model. Then, we automatically learn the adaptive spherical decision boundary for each known class with the aid of well-trained features. Specifically, we propose a new loss function to balance both the empirical risk and the open space risk. Our method does not need open intent samples and is free from modifying the model architecture. Moreover, our approach is surprisingly insensitive with less labeled data and fewer known intents. Extensive experiments on three benchmark datasets show that our method yields significant improvements compared with the state-of-the-art methods. The codes are released at https://github.com/thuiar/Adaptive-Decision-Boundary.
Code (1)
Tasks
ClassificationGeneral Classificationintent-classificationIntent ClassificationOpen Intent DetectionSimilar Papers 제목 키워드 기반
Multi-Granularity Open Intent Classification via Adaptive Granular-Ball Decision Boundary
Open intent classification is critical for the development of dialogue systems, aiming to accurately classify known intents into their corresponding classes while identifying unknown intents. Prior boundary-based methods…
Classificationintent-classificationIntent ClassificationRepresentation LearningEffective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary
Open intent classification, which aims to correctly classify the known intents into their corresponding classes while identifying the new unknown (open) intents, is an essential but challenging task in dialogue systems. …
Contrastive Learningintent-classificationIntent ClassificationLearning Better Intent Representations for Financial Open Intent Classification
With the recent surge of NLP technologies in the financial domain, banks and other financial entities have adopted virtual agents (VA) to assist customers. A challenging problem for VAs in this domain is determining a us…
Classificationintent-classificationIntent ClassificationLanguage Modeling+2Ellipsoid-Based Decision Boundaries for Open Intent Classification
Textual open intent classification is crucial for real-world dialogue systems, enabling robust detection of unknown user intents without prior knowledge and contributing to the robustness of the system. While adaptive de…
Open Intent DetectionIntent ClassificationContrastive LearningText ClassificationLearning Discriminative Representations and Decision Boundaries for Open Intent Detection
Open intent detection is a significant problem in natural language understanding, which aims to identify the unseen open intent while ensuring known intent identification performance. However, current methods face two ma…
Intent DetectionNatural Language UnderstandingOpen Intent Detection