paper-with-me

Papers

Reasoning-Based Refinement of Unsupervised Text Clusters with LLMs

2026-04-08 · Tunazzina Islam arxiv

Unsupervised methods are widely used to induce latent semantic structure from large text collections, yet their outputs often contain incoherent, redundant, or poorly grounded clusters that are difficult to validate without labeled data. We propose a reasoning-based refinement framework that leverages large language models (LLMs) not as embedding generators, but as semantic judges that validate and restructure the outputs of arbitrary unsupervised clustering algorithms. Our framework introduces three reasoning stages: (i) coherence verification, where LLMs assess whether cluster summaries are supported by their member texts; (ii) redundancy adjudication, where candidate clusters are merged or rejected based on semantic overlap; and (iii) label grounding, where clusters are assigned interpretable labels through a two-stage process that generates and consolidates semantically similar labels in a fully unsupervised manner. This design decouples representation learning from structural validation and mitigates the common failure modes of embedding-only approaches. We evaluate the framework in real-world social media corpora from two platforms with distinct interaction models, demonstrating consistent improvements in cluster coherence and human-aligned labeling quality over classical topic models and recent representation-based baselines. Human evaluation shows strong agreement with LLM-generated labels, despite the absence of gold-standard annotations. We further conduct robustness analysis under matched temporal and volume conditions to assess cross-platform stability. Beyond empirical gains, our results suggest that LLM-based reasoning can serve as a general mechanism for validating and refining unsupervised semantic structure, enabling more reliable and interpretable analysis of large text collections without supervision.

📄 PDF Abstract BibTeX arXiv:2604.07562

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningTopic Models

Similar Papers 제목 키워드 기반

Pseudo Labels Refinement with Intra-camera Similarity for Unsupervised Person Re-identification

2023-04-25 · Pengna Li, Kangyi Wu, Sanping Zhou. Qianxin Huang, Jinjun Wang

Unsupervised person re-identification (Re-ID) aims to retrieve person images across cameras without any identity labels. Most clustering-based methods roughly divide image features into clusters and neglect the feature d…

ClusteringPerson Re-IdentificationUnsupervised Person Re-Identification

NILC: Discovering New Intents with LLM-assisted Clustering

2025-11-08 · Hongtao Wang, Renchi Yang, Wenqing Lin arxiv

New intent discovery (NID) seeks to recognize both new and known intents from unlabeled user utterances, which finds prevalent use in practical dialogue systems. Existing works towards NID mainly adopt a cascaded archite…

Intent Discovery

Learn by Guessing: Multi-Step Pseudo-Label Refinement for Person Re-Identification

2021-01-04 · Tiago de C. G. Pereira, Teofilo E. de Campos

Unsupervised Domain Adaptation (UDA) methods for person Re-Identification (Re-ID) rely on target domain samples to model the marginal distribution of the data. To deal with the lack of target domain labels, UDA methods l…

ClusteringDomain AdaptationPerson Re-IdentificationPseudo Label+1

LLM-MemCluster: Empowering Large Language Models with Dynamic Memory for Text Clustering

2025-11-19 · Yuanjie Zhu, Liangwei Yang, Ke Xu, Weizhi Zhang 외 arxiv

Large Language Models (LLMs) are reshaping unsupervised learning by offering an unprecedented ability to perform text clustering based on their deep semantic understanding. However, their direct application is fundamenta…

Text Clustering

Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation

2025-02-18 · Kounianhua Du, Hanjing Wang, Jianxing Liu, Jizheng Chen 외

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, particularly in system 1 tasks, yet the intricacies of their problem-solving mechanisms in system 2 tasks are not sufficiently ex…

Code Generation