paper-with-me

Papers

Minimax Estimation of Linear Functions of Eigenvectors in the Face of Small Eigen-Gaps

2021-04-07 · Gen Li, Changxiao Cai, H. Vincent Poor, Yuxin Chen

Eigenvector perturbation analysis plays a vital role in various data science applications. A large body of prior works, however, focused on establishing $\ell_{2}$ eigenvector perturbation bounds, which are often highly inadequate in addressing tasks that rely on fine-grained behavior of an eigenvector. This paper makes progress on this by studying the perturbation of linear functions of an unknown eigenvector. Focusing on two fundamental problems -- matrix denoising and principal component analysis -- in the presence of Gaussian noise, we develop a suite of statistical theory that characterizes the perturbation of arbitrary linear functions of an unknown eigenvector. In order to mitigate a non-negligible bias issue inherent to the natural ``plug-in'' estimator, we develop de-biased estimators that (1) achieve minimax lower bounds for a family of scenarios (modulo some logarithmic factor), and (2) can be computed in a data-driven manner without sample splitting. Noteworthily, the proposed estimators are nearly minimax optimal even when the associated eigen-gap is {\em substantially smaller} than what is required in prior statistical theory.

📄 PDF Abstract BibTeX arXiv:2104.03298

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising

Similar Papers 제목 키워드 기반

Minimax Optimal Regression over Sobolev Spaces via Laplacian Eigenmaps on Neighborhood Graphs

2021-11-14 · Alden Green, Sivaraman Balakrishnan, Ryan J. Tibshirani

In this paper we study the statistical properties of Principal Components Regression with Laplacian Eigenmaps (PCR-LE), a method for nonparametric regression based on Laplacian Eigenmaps (LE). PCR-LE works by projecting …

regression

Minimax sparse principal subspace estimation in high dimensions

2012-11-02 · Vincent Q. Vu, Jing Lei

We study sparse principal components analysis in high dimensions, where $p$ (the number of variables) can be much larger than $n$ (the number of observations), and analyze the problem of estimating the subspace spanned b…

Vocal Bursts Intensity Prediction

Near-Minimax Optimal Estimation With Shallow ReLU Neural Networks

2021-09-18 · Rahul Parhi, Robert D. Nowak

We study the problem of estimating an unknown function from noisy data using shallow ReLU neural networks. The estimators we study minimize the sum of squared data-fitting errors plus a regularization term proportional t…

Advantage of Deep Neural Networks for Estimating Functions with Singularity on Hypersurfaces

2020-11-04 · Masaaki Imaizumi, Kenji Fukumizu

We develop a minimax rate analysis to describe the reason that deep neural networks (DNNs) perform better than other standard methods. For nonparametric regression problems, it is well known that many standard methods at…

Adaptive deep learning for nonlinear time series models

2022-07-06 · Daisuke Kurisu, Riku Fukami, Yuta Koike

In this paper, we develop a general theory for adaptive nonparametric estimation of the mean function of a non-stationary and nonlinear time series model using deep neural networks (DNNs). We first consider two types of …

Deep LearningregressionTime SeriesTime Series Analysis+1