paper-with-me

Papers

Inference and Uncertainty Quantification for Streaming $r$-PCA

2026-08-18 · Haoshu Xu, Hongzhe Li arxiv

We address two open questions in streaming PCA via Oja's algorithm: sharp operator-norm convergence for general rank under sub-Gaussian data, and distributional inference for the resulting subspace estimator. Existing convergence analyses, even in the rank-one case, either assume bounded data or leave non-vanishing remainder terms that prevent adaptation to a polynomially vanishing tail spectrum, while existing distributional results are confined to the rank-one case. Our convergence theory removes these remainder terms and yields a sharp rate. In the dense-tail spiked covariance regime, this rate matches the minimax rate up to logarithmic factors. More generally, we prove a matching lower bound, up to logarithmic factors, across both dense-tail and sparse-tail regimes under a mild nondegeneracy condition. The analysis yields a linearization of Oja's iterates, which in turn enables a high-dimensional Gaussian approximation for the general-rank subspace estimation error with an explicit limiting covariance. We also establish a row-wise Gaussian approximation over convex sets for the aligned difference, recovering prior rank-one results as special cases. For practical inference, we develop an online multiplier bootstrap algorithm and prove its consistency. Beyond streaming PCA, our techniques contribute to Gaussian approximation and bootstrap inference for nonconvex stochastic approximation.

📄 PDF Abstract BibTeX arXiv:2608.18374

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Sin-Squared Error: Linear-Time Entrywise Uncertainty Quantification for Streaming PCA

2025-06-14 · Syamantak Kumar, Shourya Pandey, Purnamrita Sarkar

We propose a novel statistical inference framework for streaming principal component analysis (PCA) using Oja's algorithm, enabling the construction of confidence intervals for individual entries of the estimated eigenve…

Uncertainty Quantification

Uncertainty Quantification for Inferring Hawkes Networks

2020-06-12 · NeurIPS 2020 12 · Haoyun Wang, Liyan Xie, Alex Cuozzo, Simon Mak 외

Multivariate Hawkes processes are commonly used to model streaming networked event data in a wide variety of applications. However, it remains a challenge to extract reliable inference from complex datasets with uncertai…

Uncertainty Quantification

Inference of Online Newton Methods with Nesterov's Accelerated Sketching

2026-04-25 · Haoxuan Wang, Xinchen Du, Sen Na arxiv

Reliable decision-making with streaming data requires principled uncertainty quantification of online methods. While first-order methods enable efficient iterate updates, their inference procedures still require updating…

Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning

2024-04-12 · Zongren Zou, Tingwei Meng, Paula Chen, Jérôme Darbon 외

Uncertainty quantification (UQ) in scientific machine learning (SciML) combines the powerful predictive power of SciML with methods for quantifying the reliability of the learned models. However, two major challenges rem…

Bayesian InferenceUncertainty Quantification

Bayesian Continual Learning via Spiking Neural Networks

2022-08-29 · Nicolas Skatchkovsky, Hyeryung Jang, Osvaldo Simeone

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by…

Continual LearningManagementUncertainty Quantification