paper-with-me

홈 › Papers

Normal Approximation and Confidence Region of Singular Subspaces

2019-01-02 · Dong Xia

This paper is on the normal approximation of singular subspaces when the noise matrix has i.i.d. entries. Our contributions are three-fold. First, we derive an explicit representation formula of the empirical spectral projectors. The formula is neat and holds for deterministic matrix perturbations. Second, we calculate the expected projection distance between the empirical singular subspaces and true singular subspaces. Our method allows obtaining arbitrary $k$-th order approximation of the expected projection distance. Third, we prove the non-asymptotical normal approximation of the projection distance with different levels of bias corrections. By the $\lceil \log(d_1+d_2)\rceil$-th order bias corrections, the asymptotical normality holds under optimal signal-to-noise ration (SNR) condition where $d_1$ and $d_2$ denote the matrix sizes. In addition, it shows that higher order approximations are unnecessary when $|d_1-d_2|=O((d_1+d_2)^{1/2})$. Finally, we provide comprehensive simulation results to merit our theoretic discoveries. Unlike the existing results, our approach is non-asymptotical and the convergence rates are established. Our method allows the rank $r$ to diverge as fast as $o((d_1+d_2)^{1/3})$. Moreover, our method requires no eigen-gap condition (except the SNR) and no constraints between $d_1$ and $d_2$.

📄 PDF Abstract BibTeX arXiv:1901.00304

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Confidence Region of Singular Subspaces for Low-rank Matrix Regression

2018-05-24 · Dong Xia

Low-rank matrix regression refers to the instances of recovering a low-rank matrix based on specially designed measurements and the corresponding noisy outcomes. In the last decade, numerous statistical methodologies hav…

regression

Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysis

2024-02-15 · Sangil Han, Kyoowon Kim, Sungkyu Jung

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice…

Generalized Leverage Scores: Geometric Interpretation and Applications

2022-06-16 · Bruno Ordozgoiti, Antonis Matakos, Aristides Gionis

In problems involving matrix computations, the concept of leverage has found a large number of applications. In particular, leverage scores, which relate the columns of a matrix to the subspaces spanned by its leading si…

Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems

2025-07-09 · Minchan Jeong, J. Jon Ryu, Se-Young Yun, Gregory W. Wornell arxiv

The Koopman operator provides a principled framework for analyzing nonlinear dynamical systems through linear operator theory. Recent advances in dynamic mode decomposition (DMD) have shown that trajectory data can be us…

Sampling-based Nyström Approximation and Kernel Quadrature

2023-01-23 · Satoshi Hayakawa, Harald Oberhauser, Terry Lyons

We analyze the Nystr\"om approximation of a positive definite kernel associated with a probability measure. We first prove an improved error bound for the conventional Nystr\"om approximation with i.i.d. sampling and sin…

Learning Theory