paper-with-me

Papers

An Interpretable and Stable Framework for Sparse Principal Component Analysis

2026-03-14 · Ying Hu, Hu Yang arxiv

Sparse principal component analysis (SPCA) addresses the poor interpretability and variable redundancy often encountered by principal component analysis (PCA) in high-dimensional data. However, SPCA typically imposes uniform penalties on variables and does not account for differences in variable importance, which may lead to unstable performance in highly noisy or structurally complex settings. We propose SP-SPCA, a method that introduces a single equilibrium parameter into the regularization framework to adaptively adjust variable penalties. This modification of the L2 penalty provides flexible control over the trade-off between sparsity and explained variance while maintaining computational efficiency. Simulation studies show that the proposed method consistently outperforms standard sparse principal component methods in identifying sparse loading patterns, filtering noise variables, and preserving cumulative variance, especially in high-dimensional and noisy settings. Empirical applications to crime and financial market data further demonstrate its practical utility. In real data analyses, the method selects fewer but more relevant variables, thereby reducing model complexity while maintaining explanatory power. Overall, the proposed approach offers a robust and efficient alternative for sparse modeling in complex high-dimensional data, with clear advantages in stability, feature selection, and interpretability

📄 PDF Abstract BibTeX arXiv:2603.13806

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Localized Sparse Principal Component Analysis of Multivariate Time Series in Frequency Domain

2024-08-15 · Jamshid Namdari, Amita Manatunga, Fabio Ferrarelli, Robert Krafty

Principal component analysis has been a main tool in multivariate analysis for estimating a low dimensional linear subspace that explains most of the variability in the data. However, in high-dimensional regimes, naive e…

EEGTime Series

Sparse principal component regression for generalized linear models

2016-09-28 · Shuichi. Kawano, Hironori Fujisawa, Toyoyuki Takada, Toshihiko Shiroishi

Principal component regression (PCR) is a widely used two-stage procedure: principal component analysis (PCA), followed by regression in which the selected principal components are regarded as new explanatory variables i…

parameter estimationregression

Structured Sparse Principal Components Analysis with the TV-Elastic Net penalty

2016-09-06 · Amicie de Pierrefeu, Tommy Löfstedt, Fouad Hadj-Selem, Mathieu Dubois 외

Principal component analysis (PCA) is an exploratory tool widely used in data analysis to uncover dominant patterns of variability within a population. Despite its ability to represent a data set in a low-dimensional spa…

A variational approach to stable principal component pursuit

2014-06-04 · Aleksandr Aravkin, Stephen Becker, Volkan Cevher, Peder Olsen

We introduce a new convex formulation for stable principal component pursuit (SPCP) to decompose noisy signals into low-rank and sparse representations. For numerical solutions of our SPCP formulation, we first develop a…

A New Basis for Sparse Principal Component Analysis

2020-07-01 · Fan Chen, Karl Rohe

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approxi…

ClusteringDimensionality Reduction