paper-with-me

Papers

Representation Learning via Consistent Assignment of Views to Clusters

2021-12-31 · Thalles Silva, Adín Ramírez Rivera

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive learning from a clustering perspective, CARL learns unsupervised representations by learning a set of general prototypes that serve as energy anchors to enforce different views of a given image to be assigned to the same prototype. Unlike contemporary work on contrastive learning with deep clustering, CARL proposes to learn the set of general prototypes in an online fashion, using gradient descent without the necessity of using non-differentiable algorithms or K-Means to solve the cluster assignment problem. CARL surpasses its competitors in many representations learning benchmarks, including linear evaluation, semi-supervised learning, and transfer learning.

📄 PDF Abstract BibTeX arXiv:2112.15421

Code (1)

https://gitlab.com/mipl/carl 공식 구현 pytorch

Tasks

ClusteringContrastive LearningDeep ClusteringLinear evaluationRepresentation LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Deep Multiview Clustering by Contrasting Cluster Assignments

2023-04-21 · ICCV 2023 1 · Jie Chen, Hua Mao, Wai Lok Woo, Xi Peng

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale dat…

ClusteringContrastive LearningMultiview Clustering

Representation Learning via Consistent Assignment of Views over Random Partitions

2023-10-19 · NeurIPS 2023 11 · Thalles Silva, Adín Ramírez Rivera

We present Consistent Assignment of Views over Random Partitions (CARP), a self-supervised clustering method for representation learning of visual features. CARP learns prototypes in an end-to-end online fashion using gr…

Copy DetectionImage RetrievalLinear evaluationRepresentation Learning+2

Deep Embedded Clustering with Distribution Consistency Preservation for Attributed Networks

2022-05-28 · Yimei Zheng, Caiyan Jia, Jian Yu, Xuanya Li

Many complex systems in the real world can be characterized by attributed networks. To mine the potential information in these networks, deep embedded clustering, which obtains node representations and clusters simultane…

AttributeClustering

GOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation Learning

2022-07-20 · Huseyin Coskun, Alireza Zareian, Joshua L. Moore, Federico Tombari 외

Clustering is a ubiquitous tool in unsupervised learning. Most of the existing self-supervised representation learning methods typically cluster samples based on visually dominant features. While this works well for imag…

Action RecognitionClusteringOptical Flow EstimationRepresentation Learning+4

Unsupervised Learning of Visual Features by Contrasting Cluster Assignments

2020-06-17 · NeurIPS 2020 12 · Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal 외

Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and…

Contrastive LearningData AugmentationImage ClassificationSelf-Supervised Image Classification+1