Multi-View Deep Network for Cross-View Classification
Cross-view recognition that intends to classify samples between different views is an important problem in computer vision. The large discrepancy between different even heterogenous views make this problem quite challenging. To eliminate the complex (maybe even highly nonlinear) view discrepancy for favorable cross-view recognition, we propose a multi-view deep network (MvDN), which seeks for a non-linear discriminant and view-invariant representation shared between multiple views. Specifically, our proposed MvDN network consists of two sub-networks, view-specific sub-network attempting to remove view-specific variations and the following common sub-network attempting to obtain common representation shared by all views. As the objective of MvDN network, the Fisher loss, i.e. the Rayleigh quotient objective, is calculated from the samples of all views so as to guide the learning of the whole network. As a result, the representation from the topmost layers of the MvDN network is robust to view discrepancy, and also discriminative. The experiments of face recognition across pose and face recognition across feature type on three datasets with 13 and 2 views respectively demonstrate the superiority of the proposed method, especially compared to the typical linear ones.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFace RecognitionGeneral ClassificationSimilar Papers 제목 키워드 기반
XFMamba: Cross-Fusion Mamba for Multi-View Medical Image Classification
Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views.…
Classificationimage-classificationImage ClassificationMamba+1Reliable Representations Learning for Incomplete Multi-View Partial Multi-Label Classification
As a cross-topic of multi-view learning and multi-label classification, multi-view multi-label classification has gradually gained traction in recent years. The application of multi-view contrastive learning has further …
ClassificationContrastive LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2Multi-view Hybrid Embedding: A Divide-and-Conquer Approach
We present a novel cross-view classification algorithm where the gallery and probe data come from different views. A popular approach to tackle this problem is the multi-view subspace learning (MvSL) that aims to learn a…
ClassificationGeneral ClassificationEmbedded Deep Bilinear Interactive Information and Selective Fusion for Multi-view Learning
As a concrete application of multi-view learning, multi-view classification improves the traditional classification methods significantly by integrating various views optimally. Although most of the previous efforts have…
ClassificationGeneral ClassificationMULTI-VIEW LEARNINGTask-Augmented Cross-View Imputation Network for Partial Multi-View Incomplete Multi-Label Classification
In real-world scenarios, multi-view multi-label learning often encounters the challenge of incomplete training data due to limitations in data collection and unreliable annotation processes. The absence of multi-view fea…
ImputationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label Learning