A Self-Training Approach for Short Text Clustering
Short text clustering is a challenging problem when adopting traditional bag-of-words or TF-IDF representations, since these lead to sparse vector representations of the short texts. Low-dimensional continuous representations or embeddings can counter that sparseness problem: their high representational power is exploited in deep clustering algorithms. While deep clustering has been studied extensively in computer vision, relatively little work has focused on NLP. The method we propose, learns discriminative features from both an autoencoder and a sentence embedding, then uses assignments from a clustering algorithm as supervision to update weights of the encoder network. Experiments on three short text datasets empirically validate the effectiveness of our method.
Code (1)
Tasks
ClusteringDeep ClusteringSentenceSentence EmbeddingSentence-EmbeddingShort Text ClusteringText ClusteringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-Taught Convolutional Neural Networks for Short Text Clustering
Short text clustering is a challenging problem due to its sparseness of text representation. Here we propose a flexible Self-Taught Convolutional neural network framework for Short Text Clustering (dubbed STC^2), which c…
ClusteringDimensionality ReductionShort Text ClusteringText Clustering+1Self-supervised Document Clustering Based on BERT with Data Augment
Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder…
ClusteringContrastive LearningData AugmentationText ClusteringRobust Representation Learning with Reliable Pseudo-labels Generation via Self-Adaptive Optimal Transport for Short Text Clustering
Short text clustering is challenging since it takes imbalanced and noisy data as inputs. Existing approaches cannot solve this problem well, since (1) they are prone to obtain degenerate solutions especially on heavy imb…
ClusteringContrastive LearningPseudo LabelRepresentation Learning+2Attentive Representation Learning with Adversarial Training for Short Text Clustering
Short text clustering has far-reaching effects on semantic analysis, showing its importance for multiple applications such as corpus summarization and information retrieval. However, it inevitably encounters the severe s…
ClusteringInformation RetrievalRepresentation LearningRetrieval+2Image Clustering Algorithm Based on Self-Supervised Pretrained Models and Latent Feature Distribution Optimization
In the face of complex natural images, existing deep clustering algorithms fall significantly short in terms of clustering accuracy when compared to supervised classification methods, making them less practical. This pap…
ClusteringDeep ClusteringImage Clustering