Multi-Manifold Deep Metric Learning for Image Set Classification
In this paper, we propose a multi-manifold deep metric learning (MMDML) method for image set classification, which aims to recognize an object of interest from a set of image instances captured from varying viewpoints or under varying illuminations. Motivated by the fact that manifold can be effectively used to model the nonlinearity of samples in each image set and deep learning has demonstrated superb capability to model the nonlinearity of samples, we propose a MMDML method to learn multiple sets of nonlinear transformations, one set for each object class, to nonlinearly map multiple sets of image instances into a shared feature subspace, under which the manifold margin of different class is maximized, so that both discriminative and class-specific information can be exploited, simultaneously. Our method achieves the state-of-the-art performance on five widely used datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationMetric LearningSimilar Papers 제목 키워드 기반
Multiple Manifolds Metric Learning with Application to Image Set Classification
In image set classification, a considerable advance has been made by modeling the original image sets by second order statistics or linear subspace, which typically lie on the Riemannian manifold. Specifically, they are …
ClassificationFace RecognitionGeneral ClassificationMetric Learning+1Multiview Manifold Evidential Fusion for PolSAR Image Classification
Polarimetric Synthetic Aperture Radar (PolSAR) covariance matrices and their extracted multi-features - such as scattering angle, entropy, texture, and boundary descriptors - provide complementary and physically interpre…
Image ClassificationMetric LearningProbabilistic Learning Vector Quantization on Manifold of Symmetric Positive Definite Matrices
In this paper, we develop a new classification method for manifold-valued data in the framework of probabilistic learning vector quantization. In many classification scenarios, the data can be naturally represented by sy…
EEGElectroencephalogram (EEG)General ClassificationMotor Imagery+1Embedding Propagation: Smoother Manifold for Few-Shot Classification
Few-shot classification is challenging because the data distribution of the training set can be widely different to the test set as their classes are disjoint. This distribution shift often results in poor generalization…
ClassificationFew-Shot Image ClassificationGeneral ClassificationTransductive LearningMultiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning
The importance of wild video based image set recognition is becoming monotonically increasing. However, the contents of these collected videos are often complicated, and how to efficiently perform set modeling and featur…
ClassificationEmotion RecognitionFace RecognitionGeneral Classification+3