Online Principal Component Analysis in High Dimension: Which Algorithm to Choose?
In the current context of data explosion, online techniques that do not require storing all data in memory are indispensable to routinely perform tasks like principal component analysis (PCA). Recursive algorithms that update the PCA with each new observation have been studied in various fields of research and found wide applications in industrial monitoring, computer vision, astronomy, and latent semantic indexing, among others. This work provides guidance for selecting an online PCA algorithm in practice. We present the main approaches to online PCA, namely, perturbation techniques, incremental methods, and stochastic optimization, and compare their statistical accuracy, computation time, and memory requirements using artificial and real data. Extensions to missing data and to functional data are discussed. All studied algorithms are available in the R package onlinePCA on CRAN.
Code (0)
등록된 구현이 없습니다.
Tasks
AstronomyStochastic OptimizationVocal Bursts Intensity PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A kernel Principal Component Analysis (kPCA) digest with a new backward mapping (pre-image reconstruction) strategy
Methodologies for multidimensionality reduction aim at discovering low-dimensional manifolds where data ranges. Principal Component Analysis (PCA) is very effective if data have linear structure. But fails in identifying…
Dimensionality ReductionImage ReconstructionNear-Optimal Stochastic Approximation for Online Principal Component Estimation
Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theore…
Nonlinear demixed component analysis for neural population data as a low-rank kernel regression problem
Here I introduce an extension to demixed principal component analysis (dPCA), a linear dimensionality reduction technique for analyzing the activity of neural populations, to the case of nonlinear components. This extens…
Dimensionality ReductionregressionOnline Kernel Sliced Inverse Regression
Online dimension reduction is a common method for high-dimensional streaming data processing. Online principal component analysis, online sliced inverse regression, online kernel principal component analysis and other me…
Dimensionality ReductionregressionStochastic OptimizationDeep Kernel Principal Component Analysis for Multi-level Feature Learning
Principal Component Analysis (PCA) and its nonlinear extension Kernel PCA (KPCA) are widely used across science and industry for data analysis and dimensionality reduction. Modern deep learning tools have achieved great …
Dimensionality Reduction