paper-with-me

홈 › Papers

Compact and Infinite-Order Error Analysis for Null-Space SVD Estimation

2026-08-31 · Xin Li, Jonathan Cohen, Rami Puzis arxiv

We study null-space estimation from a noisy matrix. For a simple left null space, we first derive an exact compact expression for the error of the smallest left singular vector. We then give an all-order series for the SVD vector and projector, followed by compact and consistently truncated series forms for the fixed-realization empirical risk and conditional population generalization risk. The recursion extends to a multiple-dimensional null space by following the complete invariant subspace. The convergence radius is not inferred from an error plot: it is computed independently from the nearest complex exceptional point that joins a retained eigenvalue branch to its complement. A reduced-nullity experiment shows that moving this spectral boundary can increase the radius, although the improvement is not monotone in the retained nullity. For individually ordered null directions under Gaussian training with \(τ\geq m\), we prove that the Wishart splitting matrix \(W\) gives a strict second-order empirical ranking. Gaussian averaging equalizes the leading generalization risks at both small and very large noise, while a column-swap theorem proves strict expected generalization ranking for an isotropic signal subspace. For unequal spikes, an exact population-overlap criterion and a simultaneous \(99\%\) Monte Carlo confidence certificate explain the observed intermediate ranking. A sixth-order risk correction improves the lower-crossover estimate in the reported experiment. This equal--ranked--equal phenomenon is a finite-sample diagnostic related to spectral mixing, but its tolerance crossings, the exceptional-point radius, and the asymptotic BBP threshold are three distinct quantities.

📄 PDF Abstract BibTeX arXiv:2608.30374

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Robust Inference on Infinite and Growing Dimensional Time Series Regression

2019-11-20 · Abhimanyu Gupta, Myung Hwan Seo

We develop a class of tests for time series models such as multiple regression with growing dimension, infinite-order autoregression and nonparametric sieve regression. Examples include the Chow test and general linear r…

regressionTime SeriesTime Series AnalysisTime Series Regression

A Fast, Consistent Kernel Two-Sample Test

2009-12-01 · NeurIPS 2009 12 · Arthur Gretton, Kenji Fukumizu, Zaïd Harchaoui, Bharath K. Sriperumbudur

A kernel embedding of probability distributions into reproducing kernel Hilbert spaces (RKHS) has recently been proposed, which allows the comparison of two probability measures P and Q based on the distance between the…

Vocal Bursts Valence Prediction

On solving infinite-dimensional Toeplitz Block LMIs

2023-03-15 · Flora Vernerey, Pierre Riedinger, Jamal Daafouz

This paper focuses on the resolution of infinite-dimensional Toeplitz Block LMIs, which are frequently encountered in the context of stability analysis and control design problems formulated in the harmonic framework. We…

Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space

2021-06-09 · Sho Sonoda, Isao Ishikawa, Masahiro Ikeda

Overparametrization has been remarkably successful for deep learning studies. This study investigates an overlooked but important aspect of overparametrized neural networks, that is, the null components in the parameters…

Deep Learning

On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networks

2023-08-18 · Bangti Jin, Zehui Zhou, Jun Zou

Invertible neural networks (INNs) represent an important class of deep neural network architectures that have been widely used in several applications. The universal approximation properties of INNs have also been establ…