Self Supervised Correlation-based Permutations for Multi-View Clustering
Combining data from different sources can improve data analysis tasks such as clustering. However, most of the current multi-view clustering methods are limited to specific domains or rely on a suboptimal and computationally intensive two-stage process of representation learning and clustering. We propose an end-to-end deep learning-based multi-view clustering framework for general data types (such as images and tables). Our approach involves generating meaningful fused representations using a novel permutation-based canonical correlation objective. We provide a theoretical analysis showing how the learned embeddings approximate those obtained by supervised linear discriminant analysis (LDA). Cluster assignments are learned by identifying consistent pseudo-labels across multiple views. Additionally, we establish a theoretical bound on the error caused by incorrect pseudo-labels in the unsupervised representations compared to LDA. Extensive experiments on ten multi-view clustering benchmark datasets provide empirical evidence for the effectiveness of the proposed model.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringPseudo LabelRepresentation LearningSimilar Papers 제목 키워드 기반
Self-Supervised Learning of Audio Representations from Permutations with Differentiable Ranking
Self-supervised pre-training using so-called "pretext" tasks has recently shown impressive performance across a wide range of modalities. In this work, we advance self-supervised learning from permutations, by pre-traini…
ClassificationGeneral ClassificationSelf-Supervised LearningShuffle to Learn: Self-supervised learning from permutations via differentiable ranking
Self-supervised pre-training using so-called "pretext" tasks has recently shown impressive performance across a wide range of tasks. In this work we advance self-supervised learning from permutations, that consists in sh…
General ClassificationSelf-Supervised LearningVideo ClassificationImproving Spatiotemporal Self-Supervision by Deep Reinforcement Learning
Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the …
Deep Reinforcement LearningGeneral Classificationreinforcement-learningReinforcement Learning+5Multi-View Correlation Consistency for Semi-Supervised Semantic Segmentation
Semi-supervised semantic segmentation needs rich and robust supervision on unlabeled data. Consistency learning enforces the same pixel to have similar features in different augmented views, which is a robust signal but …
Contrastive LearningData AugmentationSemantic SegmentationSemi-Supervised Semantic SegmentationDeep Incomplete Multi-view Learning via Cyclic Permutation of VAEs
Multi-View Representation Learning (MVRL) aims to derive a unified representation from multi-view data by leveraging shared and complementary information across views. However, when views are irregularly missing, the inc…
MULTI-VIEW LEARNINGRepresentation Learningvalid