Weighted Fisher Discriminant Analysis in the Input and Feature Spaces
Fisher Discriminant Analysis (FDA) is a subspace learning method which minimizes and maximizes the intra- and inter-class scatters of data, respectively. Although, in FDA, all the pairs of classes are treated the same way, some classes are closer than the others. Weighted FDA assigns weights to the pairs of classes to address this shortcoming of FDA. In this paper, we propose a cosine-weighted FDA as well as an automatically weighted FDA in which weights are found automatically. We also propose a weighted FDA in the feature space to establish a weighted kernel FDA for both existing and newly proposed weights. Our experiments on the ORL face recognition dataset show the effectiveness of the proposed weighting schemes.
Code (1)
Tasks
Dimensionality ReductionFace RecognitionSimilar Papers 제목 키워드 기반
Distance weighted discrimination of face images for gender classification
We illustrate the advantages of distance weighted discrimination for classification and feature extraction in a High Dimension Low Sample Size (HDLSS) situation. The HDLSS context is a gender classification problem of fa…
ClassificationGender ClassificationGeneral ClassificationEssence of kernel Fisher discriminant: KPCA plus LDA
In this paper, the method of kernel Fisher discriminant (KFD) is analyzed and its nature is revealed, i.e., KFD is equivalent to kernel principal component analysis (KPCA) plus Fisher linear discriminant analysis (LDA).…
Spectral, Probabilistic, and Deep Metric Learning: Tutorial and Survey
This is a tutorial and survey paper on metric learning. Algorithms are divided into spectral, probabilistic, and deep metric learning. We first start with the definition of distance metric, Mahalanobis distance, and gene…
Dimensionality ReductionMetric LearningSurveyTripletFisher and Kernel Fisher Discriminant Analysis: Tutorial
This is a detailed tutorial paper which explains the Fisher discriminant Analysis (FDA) and kernel FDA. We start with projection and reconstruction. Then, one- and multi-dimensional FDA subspaces are covered. Scatters in…
Dimensionality ReductionDiscriminant analysis based on projection onto generalized difference subspace
This paper discusses a new type of discriminant analysis based on the orthogonal projection of data onto a generalized difference subspace (GDS). In our previous work, we have demonstrated that GDS projection works as th…