Learning Representations for Clustering via Partial Information Discrimination and Cross-Level Interaction
In this paper, we present a novel deep image clustering approach termed PICI, which enforces the partial information discrimination and the cross-level interaction in a joint learning framework. In particular, we leverage a Transformer encoder as the backbone, through which the masked image modeling with two paralleled augmented views is formulated. After deriving the class tokens from the masked images by the Transformer encoder, three partial information learning modules are further incorporated, including the PISD module for training the auto-encoder via masked image reconstruction, the PICD module for employing two levels of contrastive learning, and the CLI module for mutual interaction between the instance-level and cluster-level subspaces. Extensive experiments have been conducted on six real-world image datasets, which demononstrate the superior clustering performance of the proposed PICI approach over the state-of-the-art deep clustering approaches. The source code is available at https://github.com/Regan-Zhang/PICI.
Code (1)
Tasks
ClusteringContrastive LearningDeep ClusteringImage ClusteringImage ReconstructionSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Self-similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation
Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global distribution alignment without considering class information across domains. The neglect of class information, h…
Domain AdaptationUnsupervised Domain AdaptationClustering with Jointly Learned Nonlinear Transforms Over Discriminating Min-Max Similarity/Dissimilarity Assignment
This paper presents a novel clustering concept that is based on jointly learned nonlinear transforms (NTs) with priors on the information loss and the discrimination. We introduce a clustering principle that is based on …
ClusteringImage ClusteringUnsupervised Visual Representation Learning by Online Constrained K-Means
Cluster discrimination is an effective pretext task for unsupervised representation learning, which often consists of two phases: clustering and discrimination. Clustering is to assign each instance a pseudo label that w…
ClusteringContrastive LearningImage ClusteringMetric Learning+5Stable Cluster Discrimination for Deep Clustering
Deep clustering can optimize representations of instances (i.e., representation learning) and explore the inherent data distribution (i.e., clustering) simultaneously, which demonstrates a superior performance over conve…
ClusteringDeep ClusteringImage ClusteringRepresentation Learning+1DAS-PMVC: A Framework for Partial Multi-View Clustering via Dual Alignment and Structure Enhancement
In recent years, multi-view clustering has attracted widespread research interest. However, due to limitations in data collection devices, data across different views often suffer from misalignment, leading to the partia…
Contrastive Learning