Online Adaptive Principal Component Analysis and Its extensions
We propose algorithms for online principal component analysis (PCA) and variance minimization for adaptive settings. Previous literature has focused on upper bounding the static adversarial regret, whose comparator is the optimal fixed action in hindsight. However, static regret is not an appropriate metric when the underlying environment is changing. Instead, we adopt the adaptive regret metric from the previous literature and propose online adaptive algorithms for PCA and variance minimization, that have sub-linear adaptive regret guarantees. We demonstrate both theoretically and experimentally that the proposed algorithms can adapt to the changing environments.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Online Functional Principal Component Analysis on a Multidimensional Domain
Multidimensional functional data streams arise in diverse scientific fields, yet their analysis poses significant challenges. We propose a novel online framework for functional principal component analysis that enables e…
Online Principal Component Analysis in High Dimension: Which Algorithm to Choose?
In the current context of data explosion, online techniques that do not require storing all data in memory are indispensable to routinely perform tasks like principal component analysis (PCA). Recursive algorithms that u…
AstronomyStochastic OptimizationVocal Bursts Intensity PredictionNonlinear demixed component analysis for neural population data as a low-rank kernel regression problem
Here I introduce an extension to demixed principal component analysis (dPCA), a linear dimensionality reduction technique for analyzing the activity of neural populations, to the case of nonlinear components. This extens…
Dimensionality ReductionregressionOn principal component analysis of the convex combination of two data matrices and its application to acoustic metamaterial filters
In this short paper, a matrix perturbation bound on the eigenvalues found by principal component analysis is investigated, for the case in which the data matrix on which principal component analysis is performed is a con…
Gradient-based Sparse Principal Component Analysis with Extensions to Online Learning
Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide …
Dimensionality Reduction