paper-with-me

Papers

Gradient-based Sparse Principal Component Analysis with Extensions to Online Learning

2019-11-19 · Yixuan Qiu, Jing Lei, Kathryn Roeder

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on the global convergence. Sparse PCA algorithms based on a convex formulation, for example the Fantope projection and selection (FPS), overcome this difficulty, but are computationally expensive. In this work we study sparse PCA based on the convex FPS formulation, and propose a new algorithm that is computationally efficient and applicable to large and high-dimensional data sets. Nonasymptotic and explicit bounds are derived for both the optimization error and the statistical accuracy, which can be used for testing and inference problems. We also extend our algorithm to online learning problems, where data are obtained in a streaming fashion. The proposed algorithm is applied to high-dimensional gene expression data for the detection of functional gene groups.

📄 PDF Abstract BibTeX arXiv:1911.08048

Code (2)

lxiao0620/gradfps
yixuan/gradfps

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Cross-product Penalized Component Analysis (XCAN)

2019-06-28 · José Camacho, Evrim Acar, Morten A. Rasmussen, Rasmus Bro

Matrix factorization methods are extensively employed to understand complex data. In this paper, we introduce the cross-product penalized component analysis (XCAN), a sparse matrix factorization based on the optimization…

Clustering

Objective-Sensitive Principal Component Analysis for High-Dimensional Inverse Problems

2020-06-02 · Maksim Elizarev, Andrei Mukhin, Aleksey Khlyupin

We present a novel approach for adaptive, differentiable parameterization of large-scale random fields. If the approach is coupled with any gradient-based optimization algorithm, it can be applied to a variety of optimiz…

Vocal Bursts Intensity Prediction

$e^{\text{RPCA}}$: Robust Principal Component Analysis for Exponential Family Distributions

2023-10-30 · Xiaojun Zheng, Simon Mak, Liyan Xie, Yao Xie

Robust Principal Component Analysis (RPCA) is a widely used method for recovering low-rank structure from data matrices corrupted by significant and sparse outliers. These corruptions may arise from occlusions, malicious…

Defect Detection

Online Functional Principal Component Analysis on a Multidimensional Domain

2025-05-04 · Muye Nanshan, Nan Zhang, Jiguo Cao

Multidimensional functional data streams arise in diverse scientific fields, yet their analysis poses significant challenges. We propose a novel online framework for functional principal component analysis that enables e…

On principal component analysis of the convex combination of two data matrices and its application to acoustic metamaterial filters

2021-04-04 · Giorgio Gnecco, Andrea Bacigalupo

In this short paper, a matrix perturbation bound on the eigenvalues found by principal component analysis is investigated, for the case in which the data matrix on which principal component analysis is performed is a con…