Clustering Text Using Attention
Clustering Text has been an important problem in the domain of Natural Language Processing. While there are techniques to cluster text based on using conventional clustering techniques on top of contextual or non-contextual vector space representations, it still remains a prevalent area of research possible to various improvements in performance and implementation of these techniques. This paper discusses a novel technique to cluster text using attention mechanisms. Attention Mechanisms have proven to be highly effective in various NLP tasks in recent times. This paper extends the idea of attention mechanism in clustering space and sheds some light on a whole new area of research
Code (1)
Tasks
ClusteringSimilar Papers 제목 키워드 기반
In-Context Clustering with Large Language Models
We propose In-Context Clustering (ICC), a flexible LLM-based procedure for clustering data from diverse distributions. Unlike traditional clustering algorithms constrained by predefined similarity measures, ICC flexibly …
Image ClusteringAttention-Based Clustering: Learning a Kernel from Context
In machine learning, no data point stands alone. We believe that context is an underappreciated concept in many machine learning methods. We propose Attention-Based Clustering (ABC), a neural architecture based on the at…
BIG-bench Machine LearningClusteringReliable Pseudo-labeling via Optimal Transport with Attention for Short Text Clustering
Short text clustering has gained significant attention in the data mining community. However, the limited valuable information contained in short texts often leads to low-discriminative representations, increasing the di…
ClusteringContrastive LearningRepresentation LearningShort Text Clustering+1ClusTop: An unsupervised and integrated text clustering and topic extraction framework
Text clustering and topic extraction are two important tasks in text mining. Usually, these two tasks are performed separately. For topic extraction to facilitate clustering, we can first project texts into a topic space…
ClusteringDimensionality ReductionLanguage ModelingLanguage Modelling+1Discriminative Representation learning via Attention-Enhanced Contrastive Learning for Short Text Clustering
Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the featur…
ClusteringContrastive LearningPseudo LabelRepresentation Learning+2