Representation Learning via Consistent Assignment of Views to Clusters
We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive learning from a clustering perspective, CARL learns unsupervised representations by learning a set of general prototypes that serve as energy anchors to enforce different views of a given image to be assigned to the same prototype. Unlike contemporary work on contrastive learning with deep clustering, CARL proposes to learn the set of general prototypes in an online fashion, using gradient descent without the necessity of using non-differentiable algorithms or K-Means to solve the cluster assignment problem. CARL surpasses its competitors in many representations learning benchmarks, including linear evaluation, semi-supervised learning, and transfer learning.
Code (1)
Tasks
ClusteringContrastive LearningDeep ClusteringLinear evaluationRepresentation LearningTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Multiview Clustering by Contrasting Cluster Assignments
Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale dat…
ClusteringContrastive LearningMultiview ClusteringRepresentation Learning via Consistent Assignment of Views over Random Partitions
We present Consistent Assignment of Views over Random Partitions (CARP), a self-supervised clustering method for representation learning of visual features. CARP learns prototypes in an end-to-end online fashion using gr…
Copy DetectionImage RetrievalLinear evaluationRepresentation Learning+2Deep Embedded Clustering with Distribution Consistency Preservation for Attributed Networks
Many complex systems in the real world can be characterized by attributed networks. To mine the potential information in these networks, deep embedded clustering, which obtains node representations and clusters simultane…
AttributeClusteringGOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation Learning
Clustering is a ubiquitous tool in unsupervised learning. Most of the existing self-supervised representation learning methods typically cluster samples based on visually dominant features. While this works well for imag…
Action RecognitionClusteringOptical Flow EstimationRepresentation Learning+4Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and…
Contrastive LearningData AugmentationImage ClassificationSelf-Supervised Image Classification+1