Deep Partial Multi-View Learning
Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To address the challenge, we propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets), which aims to fully and flflexibly take advantage of multiple partial views. We fifirst provide a formal defifinition of completeness and versatility for multi-view representation and then theoretically prove the versatility of the learned latent representations. For completeness, the task of learning latent multi-view representation is specififically translated to a degradation process by mimicking data transmission, such that the optimal tradeoff between consistency and complementarity across different views can be implicitly achieved. Equipped with adversarial strategy, our model stably imputes missing views, encoding information from all views for each sample to be encoded into latent representation to further enhance the completeness. Furthermore, a nonparametric classifification loss is introduced to produce structured representations and prevent overfifitting, which endows the algorithm with promising generalization under view-missing cases. Extensive experimental results validate the effectiveness of our algorithm over existing state of the arts for classifification, representation learning and data imputation.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationMULTI-VIEW LEARNINGRepresentation LearningSimilar Papers 제목 키워드 기반
Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results
As real-scanned point clouds are mostly partial due to occlusions and viewpoints, reconstructing complete 3D shapes based on incomplete observations becomes a fundamental problem for computer vision. With a single incomp…
3D ReconstructionPoint Cloud CompletionPoint Cloud RegistrationvalidGeneralized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence
Multi-view clustering (MVC) aims to explore the common clustering structure across multiple views. Many existing MVC methods heavily rely on the assumption of view consistency, where alignments for corresponding samples …
Partially Shared Semi-supervised Deep Matrix Factorization with Multi-view Data
Since many real-world data can be described from multiple views, multi-view learning has attracted considerable attention. Various methods have been proposed and successfully applied to multi-view learning, typically bas…
MULTI-VIEW LEARNINGPartially View-aligned Clustering
In this paper, we study one challenging issue in multi-view data clustering. To be specific, for two data matrices $\mathbf{X}^{(1)}$ and $\mathbf{X}^{(2)}$ corresponding to two views, we do not assume that $\mathbf{X}^{…
ClusteringPartial Multi-View Clustering via Meta-Learning and Contrastive Feature Alignment
Partial multi-view clustering (PVC) presents significant challenges practical research problem for data analysis in real-world applications, especially when some views of the data are partially missing. Existing clusteri…
ClusteringContrastive LearningMeta-LearningSelf-Supervised Learning