Self-attention Multi-view Representation Learning with Diversity-promoting Complementarity
Multi-view learning attempts to generate a model with a better performance by exploiting the consensus and/or complementarity among multi-view data. However, in terms of complementarity, most existing approaches only can find representations with single complementarity rather than complementary information with diversity. In this paper, to utilize both complementarity and consistency simultaneously, give free rein to the potential of deep learning in grasping diversity-promoting complementarity for multi-view representation learning, we propose a novel supervised multi-view representation learning algorithm, called Self-Attention Multi-View network with Diversity-Promoting Complementarity (SAMVDPC), which exploits the consistency by a group of encoders, uses self-attention to find complementary information entailing diversity. Extensive experiments conducted on eight real-world datasets have demonstrated the effectiveness of our proposed method, and show its superiority over several baseline methods, which only consider single complementary information.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityMULTI-VIEW LEARNINGRepresentation LearningSimilar Papers 제목 키워드 기반
Attention De-sparsification Matters: Inducing Diversity in Digital Pathology Representation Learning
We propose DiRL, a Diversity-inducing Representation Learning technique for histopathology imaging. Self-supervised learning techniques, such as contrastive and non-contrastive approaches, have been shown to learn rich a…
Cell SegmentationDiversityRepresentation LearningSelf-Supervised LearningMulti-view Deep Subspace Clustering Networks
Multi-view subspace clustering aims to discover the inherent structure of data by fusing multiple views of complementary information. Most existing methods first extract multiple types of handcrafted features and then le…
ClusteringDiversityModel SelectionMulti-view Subspace ClusteringLong-Range Grouping Transformer for Multi-View 3D Reconstruction
Nowadays, transformer networks have demonstrated superior performance in many computer vision tasks. In a multi-view 3D reconstruction algorithm following this paradigm, self-attention processing has to deal with intrica…
3D Object Reconstruction3D ReconstructionDecoderMulti-View 3D ReconstructionMine Your Own vieW: Self-Supervised Learning Through Across-Sample Prediction
State-of-the-art methods for self-supervised learning (SSL) build representations by maximizing the similarity between different transformed "views" of a sample. Without sufficient diversity in the transformations used t…
DiversitySelf-Supervised LearningAnalysis of Self-Attention Head Diversity for Conformer-based Automatic Speech Recognition
Attention layers are an integral part of modern end-to-end automatic speech recognition systems, for instance as part of the Transformer or Conformer architecture. Attention is typically multi-headed, where each head has…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Diversityspeech-recognition+1