paper-with-me

Papers

LUMI: Unsupervised Intent Clustering with Multiple Pseudo-Labels

2025-10-16 · I-Fan Lin, Faegheh Hasibi, Suzan Verberne arxiv

In this paper, we propose an intuitive, training-free and label-free method for intent clustering in conversational search. Current approaches to short text clustering use LLM-generated pseudo-labels to enrich text representations or to identify similar text pairs for pooling. The limitations are: (1) each text is assigned only a single label, and refining representations toward a single label can be unstable; (2) text-level similarity is treated as a binary selection, which fails to account for continuous degrees of similarity. Our method LUMI is designed to amplify similarities between texts by using shared pseudo-labels. We first generate pseudo-labels for each text and collect them into a pseudo-label set. Next, we compute the mean of the pseudo-label embeddings and pool it with the text embedding. Finally, we perform text-level pooling: Each text representation is pooled with its similar pairs, where similarity is determined by the degree of shared labels. Our evaluation on four benchmark sets shows that our approach achieves competitive results, better than recent state-of-the-art baselines, while avoiding the need to estimate the number of clusters during embedding refinement, as is required by most methods. Our findings indicate that LUMI can effectively be applied in unsupervised short-text clustering scenarios.

📄 PDF Abstract BibTeX arXiv:2510.14640

Code (0)

등록된 구현이 없습니다.

Tasks

Short Text Clustering

Similar Papers 제목 키워드 기반

Controllable Discovery of Intents: Incremental Deep Clustering Using Semi-Supervised Contrastive Learning

2024-10-18 · Mrinal Rawat, Hithesh Sankararaman, Victor Barres

Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often o…

ClusteringContinual LearningContrastive LearningDeep Clustering+2

Unsupervised Clustering using Pseudo-semi-supervised Learning

2020-05-01 · ICLR 2020 1 · Divam Gupta, Ramachandran Ramjee, Nipun Kwatra, Muthian Sivathanu

In this paper, we propose a framework that leverages semi-supervised models to improve unsupervised clustering performance. To leverage semi-supervised models, we first need to automatically generate labels, called pseud…

Clustering

Few-shot Pseudo-Labeling for Intent Detection

2020-12-08 · COLING 2020 8 · Thomas Dopierre, Christophe Gravier, Julien Subercaze, Wilfried Logerais

In this paper, we introduce a state-of-the-art pseudo-labeling technique for few-shot intent detection. We devise a folding/unfolding hierarchical clustering algorithm which assigns weighted pseudo-labels to unlabeled us…

ClusteringIntent Detectiontext-classificationText Classification

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery

2024-10-26 · Yimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu 외

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stag…

ClusteringContrastive LearningIntent DiscoveryOpen Intent Discovery+3

A Hybrid Architecture for Out of Domain Intent Detection and Intent Discovery

2023-03-07 · Masoud Akbari, Ali Mohades, M. Hassan Shirali-Shahreza

Intent Detection is one of the tasks of the Natural Language Understanding (NLU) unit in task-oriented dialogue systems. Out of Scope (OOS) and Out of Domain (OOD) inputs may run these systems into a problem. On the othe…

ClusteringDimensionality ReductionIntent DetectionIntent Discovery+3