paper-with-me

Papers

Deflation Methods for Sparse PCA

2008-12-01 · NeurIPS 2008 12 · Lester W. Mackey

In analogy to the PCA setting, the sparse PCA problem is often solved by iteratively alternating between two subtasks: cardinality-constrained rank-one variance maximization and matrix deflation. While the former has received a great deal of attention in the literature, the latter is seldom analyzed and is typically borrowed without justification from the PCA context. In this work, we demonstrate that the standard PCA deflation procedure is seldom appropriate for the sparse PCA setting. To rectify the situation, we first develop several heuristic deflation alternatives with more desirable properties. We then reformulate the sparse PCA optimization problem to explicitly reflect the maximum additional variance objective on each round. The result is a generalized deflation procedure that typically outperforms more standard techniques on real-world datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Deflation-Free Optimal Scoring

2026-04-28 · Sharmin Afroz, Brendan Ames arxiv

Sparse Optimal Scoring (SOS) reformulates linear discriminant analysis to enable feature selection through elastic net regularization, making it well-suited for high-dimensional settings where the number of features exce…

Multi-Rank Sparse and Functional PCA: Manifold Optimization and Iterative Deflation Techniques

2019-07-28 · Michael Weylandt

We consider the problem of estimating multiple principal components using the recently-proposed Sparse and Functional Principal Components Analysis (SFPCA) estimator. We first propose an extension of SFPCA which estimate…

A Fast deflation Method for Sparse Principal Component Analysis via Subspace Projections

2019-12-03 · Cong Xu, Min Yang, Jin Zhang

The implementation of conventional sparse principal component analysis (SPCA) on high-dimensional data sets has become a time consuming work. In this paper, a series of subspace projections are constructed efficiently by…

Simplifying deflation for non-convex optimization with applications in Bayesian inference and topology optimization

2022-01-28 · Mohamed Tarek, Yijiang Huang

Non-convex optimization problems have multiple local optimal solutions. Non-convex optimization problems are commonly found in numerous applications. One of the methods recently proposed to efficiently explore multiple l…

Bayesian Inference

Hotelling Deflation on Large Symmetric Spiked Tensors

2023-04-20 · Mohamed El Amine Seddik, José Henrique de Morais Goulart, Maxime Guillaud

This paper studies the deflation algorithm when applied to estimate a low-rank symmetric spike contained in a large tensor corrupted by additive Gaussian noise. Specifically, we provide a precise characterization of the …