paper-with-me

Papers

Robust Principal Component Analysis via Discriminant Sample Weight Learning

2024-08-22 · Yingzhuo Deng, Ke Hu, Bo Li, Yao Zhang

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the data mean and the PCA projection matrix by learning discriminant sample weights from data containing outliers. Each sample in the dataset is assigned a weight, and the proposed algorithm iteratively learns the weights, the mean, and the projection matrix, respectively. Specifically, when the mean and the projection matrix are available, via fine-grained analysis of outliers, a weight for each sample is learned hierarchically so that outliers have small weights while normal samples have large weights. With the learned weights available, a weighted optimization problem is solved to estimate both the data mean and the projection matrix. Because the learned weights discriminate outliers from normal samples, the adverse influence of outliers is mitigated due to the corresponding small weights. Experiments on toy data, UCI dataset, and face dataset demonstrate the effectiveness of the proposed method in estimating the mean and the projection matrix from the data containing outliers.

📄 PDF Abstract BibTeX arXiv:2408.12366

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Distance weighted discrimination of face images for gender classification

2017-06-15 · Mónica Benito, Eduardo García-Portugués, J. S. Marron, Daniel Peña

We illustrate the advantages of distance weighted discrimination for classification and feature extraction in a High Dimension Low Sample Size (HDLSS) situation. The HDLSS context is a gender classification problem of fa…

ClassificationGender ClassificationGeneral Classification

Discriminant analysis based on projection onto generalized difference subspace

2019-10-29 · Kazuhiro Fukui, Naoya Sogi, Takumi Kobayashi, Jing-Hao Xue 외

This paper discusses a new type of discriminant analysis based on the orthogonal projection of data onto a generalized difference subspace (GDS). In our previous work, we have demonstrated that GDS projection works as th…

Penalized versus constrained generalized eigenvalue problems

2014-10-22 · Irina Gaynanova, James Booth, Martin T. Wells

We investigate the difference between using an $\ell_1$ penalty versus an $\ell_1$ constraint in generalized eigenvalue problems, such as principal component analysis and discriminant analysis. Our main finding is that a…

Variable Selection

Essence of kernel Fisher discriminant: KPCA plus LDA

2003-10-15 · Pattern Recognition 2003 10 · Jian Yang; Zhong Jin; Jing-yu Yang, David Zhang, Alejandro F. Frangi

In this paper, the method of kernel Fisher discriminant (KFD) is analyzed and its nature is revealed, i.e., KFD is equivalent to kernel principal component analysis (KPCA) plus Fisher linear discriminant analysis (LDA).…

Discriminative Principal Component Analysis: A REVERSE THINKING

2019-03-12 · Hanli Qiao

In this paper, we propose a novel approach named by Discriminative Principal Component Analysis which is abbreviated as Discriminative PCA in order to enhance separability of PCA by Linear Discriminant Analysis (LDA). Th…

Face Recognition