paper-with-me

Papers

Penalized Principal Component Analysis Using Smoothing

2023-09-25 · Rebecca M. Hurwitz, Georg Hahn

Principal components computed via PCA (principal component analysis) are traditionally used to reduce dimensionality in genomic data or to correct for population stratification. In this paper, we explore the penalized eigenvalue problem (PEP) which reformulates the computation of the first eigenvector as an optimization problem and adds an $L_1$ penalty constraint to enforce sparseness of the solution. The contribution of our article is threefold. First, we extend PEP by applying smoothing to the original LASSO-type $L_1$ penalty. This allows one to compute analytical gradients which enable faster and more efficient minimization of the objective function associated with the optimization problem. Second, we demonstrate how higher order eigenvectors can be calculated with PEP using established results from singular value decomposition (SVD). Third, we present four experimental studies to demonstrate the usefulness of the smoothed penalized eigenvectors. Using data from the 1000 Genomes Project dataset, we empirically demonstrate that our proposed smoothed PEP allows one to increase numerical stability and obtain meaningful eigenvectors. We also employ the penalized eigenvector approach in two additional real data applications (computation of a polygenic risk score and clustering), demonstrating that exchanging the penalized eigenvectors for their smoothed counterparts can increase prediction accuracy in polygenic risk scores and enhance discernibility of clusterings. Moreover, we compare our proposed smoothed PEP to seven state-of-the-art algorithms for sparse PCA and evaluate the accuracy of the obtained eigenvectors, their support recovery, and their runtime.

📄 PDF Abstract BibTeX arXiv:2309.13838

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Online Functional Principal Component Analysis on a Multidimensional Domain

2025-05-04 · Muye Nanshan, Nan Zhang, Jiguo Cao

Multidimensional functional data streams arise in diverse scientific fields, yet their analysis poses significant challenges. We propose a novel online framework for functional principal component analysis that enables e…

Cross-product Penalized Component Analysis (XCAN)

2019-06-28 · José Camacho, Evrim Acar, Morten A. Rasmussen, Rasmus Bro

Matrix factorization methods are extensively employed to understand complex data. In this paper, we introduce the cross-product penalized component analysis (XCAN), a sparse matrix factorization based on the optimization…

Clustering

AgFlow: Fast Model Selection of Penalized PCA via Implicit Regularization Effects of Gradient Flow

2021-10-07 · Haiyan Jiang, Haoyi Xiong, Dongrui Wu, Ji Liu 외

Principal component analysis (PCA) has been widely used as an effective technique for feature extraction and dimension reduction. In the High Dimension Low Sample Size (HDLSS) setting, one may prefer modified principal c…

Dimensionality ReductionModel Selection

Penalized Principal Component Regression on Graphs for Analysis of Subnetworks

2010-12-01 · NeurIPS 2010 12 · Ali Shojaie, George Michailidis

Network models are widely used to capture interactions among component of complex systems, such as social and biological. To understand their behavior, it is often necessary to analyze functionally related components of …

Dimensionality Reductionregression

Penalized versus constrained generalized eigenvalue problems

2014-10-22 · Irina Gaynanova, James Booth, Martin T. Wells

We investigate the difference between using an $\ell_1$ penalty versus an $\ell_1$ constraint in generalized eigenvalue problems, such as principal component analysis and discriminant analysis. Our main finding is that a…

Variable Selection