paper-with-me

Papers

Cluster Analysis with Deep Embeddings and Contrastive Learning

2021-09-26 · Ramakrishnan Sundareswaran, Jansel Herrera-Gerena, John Just, Ali Jannesari

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with a deep embedding based cluster center predictor. Our approach jointly learns representations and predicts cluster centers in an end-to-end manner. This is accomplished via a three-pronged approach that combines a clustering loss, an instance-wise contrastive loss, and an anchor loss. Our fundamental intuition is that using an ensemble loss that incorporates instance-level features and a clustering procedure focusing on semantic similarity reinforces learning better representations in the latent space. We observe that our method performs exceptionally well on popular vision datasets when evaluated using standard clustering metrics such as Normalized Mutual Information (NMI), in addition to producing geometrically well-separated cluster embeddings as defined by the Euclidean distance. Our framework performs on par with widely accepted clustering methods and outperforms the state-of-the-art contrastive learning method on the CIFAR-10 dataset with an NMI score of 0.772, a 7-8% improvement on the strong baseline.

📄 PDF Abstract BibTeX arXiv:2109.12714

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringContrastive LearningImage ClusteringRepresentation LearningSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

From Representation to Clusters: A Contrastive Learning Approach for Attributed Hypergraph Clustering

2026-03-10 · Li Ni, Shuaikang Zeng, Lin Mu, Longlong Lin arxiv

Contrastive learning has demonstrated strong performance in attributed hypergraph clustering. Typically, existing methods based on contrastive learning first learn node embeddings and then apply clustering algorithms, su…

Representation LearningContrastive Learning

Revealing Emotional Clusters in Speaker Embeddings: A Contrastive Learning Strategy for Speech Emotion Recognition

2024-01-19 · Ismail Rasim Ulgen, Zongyang Du, Carlos Busso, Berrak Sisman

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assume…

Contrastive LearningEmotion RecognitionSpeech Emotion Recognition

Subspace Clustering on Incomplete Data with Self-Supervised Contrastive Learning

2026-01-30 · Huanran Li, Daniel Pimentel-Alarcón arxiv

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing meth…

Recommendation SystemsContrastive Learning

Structure-enhanced Contrastive Learning for Graph Clustering

2024-08-19 · Xunlian Wu, Jingqi Hu, Anqi Zhang, Yining Quan 외

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive …

ClusteringContrastive LearningData AugmentationGraph Clustering

Automatic Biomedical Term Clustering by Learning Fine-grained Term Representations

2022-04-01 · BioNLP (ACL) 2022 5 · Sihang Zeng, Zheng Yuan, Sheng Yu

Term clustering is important in biomedical knowledge graph construction. Using similarities between terms embedding is helpful for term clustering. State-of-the-art term embeddings leverage pretrained language models to …

ClusteringContrastive Learninggraph constructionKnowledge Graphs