paper-with-me

홈 › Papers

Weighted least-squares approximation with determinantal point processes and generalized volume sampling

2023-12-21 · Anthony Nouy, Bertrand Michel

We consider the problem of approximating a function from $L^2$ by an element of a given $m$-dimensional space $V_m$, associated with some feature map $\varphi$, using evaluations of the function at random points $x_1,\dots,x_n$. After recalling some results on optimal weighted least-squares using independent and identically distributed points, we consider weighted least-squares using projection determinantal point processes (DPP) or volume sampling. These distributions introduce dependence between the points that promotes diversity in the selected features $\varphi(x_i)$. We first provide a generalized version of volume-rescaled sampling yielding quasi-optimality results in expectation with a number of samples $n = O(m\log(m))$, that means that the expected $L^2$ error is bounded by a constant times the best approximation error in $L^2$. Also, further assuming that the function is in some normed vector space $H$ continuously embedded in $L^2$, we further prove that the approximation is almost surely bounded by the best approximation error measured in the $H$-norm. This includes the cases of functions from $L^\infty$ or reproducing kernel Hilbert spaces. Finally, we present an alternative strategy consisting in using independent repetitions of projection DPP (or volume sampling), yielding similar error bounds as with i.i.d. or volume sampling, but in practice with a much lower number of samples. Numerical experiments illustrate the performance of the different strategies.

📄 PDF Abstract BibTeX arXiv:2312.14057

Code (0)

등록된 구현이 없습니다.

Tasks

Point Processes

Similar Papers 제목 키워드 기반

Determinantal Point Processes in Randomized Numerical Linear Algebra

2020-05-07 · Michał Dereziński, Michael W. Mahoney

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPP…

Point Processes

Optimal sampling for least-squares approximation

2024-09-04 · Ben Adcock

Least-squares approximation is one of the most important methods for recovering an unknown function from data. While in many applications the data is fixed, in many others there is substantial freedom to choose where to …

Kernel based regression with robust loss function via iteratively reweighted least squares

2019-03-27 · Hongwei Dong, Liming Yang

Least squares kernel based methods have been widely used in regression problems due to the simple implementation and good generalization performance. Among them, least squares support vector regression (LS-SVR) and extre…

regression

Variance reduction in stochastic methods for large-scale regularised least-squares problems

2021-10-15 · Yusuf Pilavci, Pierre-Olivier Amblard, Simon Barthelmé, Nicolas Tremblay

Large dimensional least-squares and regularised least-squares problems are expensive to solve. There exist many approximate techniques, some deterministic (like conjugate gradient), some stochastic (like stochastic gradi…

Point Processes

Symmetrized Robust Procrustes: Constant-Factor Approximation and Exact Recovery

2022-07-18 · Tal Amir, Shahar Kovalsky, Nadav Dym

The classical $\textit{Procrustes}$ problem is to find a rigid motion (orthogonal transformation and translation) that best aligns two given point-sets in the least-squares sense. The $\textit{Robust Procrustes}$ problem…

TranslationWord Translation