paper-with-me

홈 › Papers

Convergence bounds for local least squares approximation

2022-08-23 · Philipp Trunschke

We consider the problem of approximating a function in a general nonlinear subset of $L^2$, when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample complexity, the number of sample points that are necessary to achieve a prescribed error with high probability. Reasonable worst-case bounds for this quantity exist only for particular model classes, like linear spaces or sets of sparse vectors. For more general sets, like tensor networks or neural networks, the currently existing bounds are very pessimistic. By restricting the model class to a neighbourhood of the best approximation, we can derive improved worst-case bounds for the sample complexity. When the considered neighbourhood is a manifold with positive local reach, its sample complexity can be estimated by means of the sample complexities of the tangent and normal spaces and the manifold's curvature.

📄 PDF Abstract BibTeX arXiv:2208.10954

Code (0)

등록된 구현이 없습니다.

Tasks

Tensor Networks

Similar Papers 제목 키워드 기반

On Asymptotic Linear Convergence of Projected Gradient Descent for Constrained Least Squares

2021-12-22 · Trung Vu, Raviv Raich

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Project…

compressed sensingImage RestorationMatrix Completion

Concentration bounds for temporal difference learning with linear function approximation: The case of batch data and uniform sampling

2013-06-11 · L. A. Prashanth, Nathaniel Korda, Rémi Munos

We propose a stochastic approximation (SA) based method with randomization of samples for policy evaluation using the least squares temporal difference (LSTD) algorithm. Our proposed scheme is equivalent to running regul…

Multi-Armed BanditsNews RecommendationregressionTraffic Signal Control

On Least Squares Estimation under Heteroscedastic and Heavy-Tailed Errors

2019-09-04 · Arun K. Kuchibhotla, Rohit K. Patra

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-G…

regression

Accelerated SGD for Non-Strongly-Convex Least Squares

2022-03-03 · Aditya Varre, Nicolas Flammarion

We consider stochastic approximation for the least squares regression problem in the non-strongly convex setting. We present the first practical algorithm that achieves the optimal prediction error rates in terms of depe…

regression

Covariance Estimation in High Dimensions via Kronecker Product Expansions

2013-02-12 · Theodoros Tsiligkaridis, Alfred O. Hero III

This paper presents a new method for estimating high dimensional covariance matrices. The method, permuted rank-penalized least-squares (PRLS), is based on a Kronecker product series expansion of the true covariance matr…

Vocal Bursts Intensity Prediction