Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification
User intent classification plays a vital role in dialogue systems. Since user intent may frequently change over time in many realistic scenarios, unknown (new) intent detection has become an essential problem, where the study has just begun. This paper proposes a semantic-enhanced Gaussian mixture model (SEG) for unknown intent detection. In particular, we model utterance embeddings with a Gaussian mixture distribution and inject dynamic class semantic information into Gaussian means, which enables learning more class-concentrated embeddings that help to facilitate downstream outlier detection. Coupled with a density-based outlier detection algorithm, SEG achieves competitive results on three real task-oriented dialogue datasets in two languages for unknown intent detection. On top of that, we propose to integrate SEG as an unknown intent identifier into existing generalized zero-shot intent classification models to improve their performance. A case study on a state-of-the-art method, ReCapsNet, shows that SEG can push the classification performance to a significantly higher level.
Code (1)
Tasks
ClassificationGeneral Classificationintent-classificationIntent ClassificationIntent DetectionOutlier DetectionZero-Shot Intent ClassificationSimilar Papers 제목 키워드 기반
Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training
Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on s…
Intent DetectionOutlier DetectionTask-Oriented Dialogue SystemsSimultaneous Input and State Estimation under Output Quantization: A Gaussian Mixture approach
Simultaneous Input and State Estimation (SISE) enables the reconstruction of unknown inputs and internal states in dynamical systems, with applications in fault detection, robotics, and control. While various methods exi…
Fault DetectionQuantizationState EstimationUnknown Intent Detection Using Multi-Objective Optimization on Deep Learning Classifiers
Modelling and understanding dialogues in a conversation depends on identifying the user intent from the given text. Unknown or new intent detection is a critical task, as in a realistic scenario a user intent may frequen…
Intent DetectionIntent DiscoveryDiffusion Gaussian Mixture Audio Denoise
Recent diffusion models have achieved promising performances in audio-denoising tasks. The unique property of the reverse process could recover clean signals. However, the distribution of real-world noises does not compl…
Audio DenoisingDenoisingGoal inference with Rao-Blackwellized Particle Filters
Inferring the eventual goal of a mobile agent from noisy observations of its trajectory is a fundamental estimation problem. We initiate the study of such intent inference using a variant of a Rao-Blackwellized Particle …