Unknown Intent Detection Using Multi-Objective Optimization on Deep Learning Classifiers
Modelling and understanding dialogues in a conversation depends on identifying the user intent from the given text. Unknown or new intent detection is a critical task, as in a realistic scenario a user intent may frequently change over time and divert even to an intent previously not encountered. This task of separating the unknown intent samples from known intents one is challenging as the unknown user intent can range from intents similar to the predefined intents to something completely different. Prior research on intent discovery often consider it as a classification task where an unknown intent can belong to a predefined set of known intent classes. In this paper we tackle the problem of detecting a completely unknown intent without any prior hints about the kind of classes belonging to unknown intents. We propose an effective post-processing method using multi-objective optimization to tune an existing neural network based intent classifier and make it capable of detecting unknown intents. We perform experiments using existing state-of-the-art intent classifiers and use our method on top of them for unknown intent detection. Our experiments across different domains and real-world datasets show that our method yields significant improvements compared with the state-of-the-art methods for unknown intent detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Intent DetectionIntent DiscoverySimilar Papers 제목 키워드 기반
Towards Multi-label Unknown Intent Detection
Multi-class unknown intent detection has made remarkable progress recently. However, it has a strong assumption that each utterance has only one intent, which does not conform to reality because utterances often have mul…
Intent DetectionUnknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification
User intent classification plays a vital role in dialogue systems. Since user intent may frequently change over time in many realistic scenarios, unknown (new) intent detection has become an essential problem, where the …
ClassificationGeneral Classificationintent-classificationIntent Classification+3A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifier
With the maturity and popularity of dialogue systems, detecting user's unknown intent in dialogue systems has become an important task. It is also one of the most challenging tasks since we can hardly get examples, prior…
Intent DetectionNovelty DetectionIntent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering
Intent Detection is a crucial component of Dialogue Systems wherein the objective is to classify a user utterance into one of multiple pre-defined intents. A pre-requisite for developing an effective intent identifier is…
ClusteringIntent DetectionIntent DiscoveryOpen Intent Discovery+2Deep Unknown Intent Detection with Margin Loss
Identifying the unknown (novel) user intents that have never appeared in the training set is a challenging task in the dialogue system. In this paper, we present a two-stage method for detecting unknown intents. We use b…
Intent DetectionNovelty DetectionOpen Intent Detection