paper-with-me

Papers

Optimal Learning Rates for Regularized Least-Squares with a Fourier Capacity Condition

2022-04-16 · Prem Talwai, David Simchi-Levi

We derive minimax adaptive rates for a new, broad class of Tikhonov-regularized learning problems in Hilbert scales under general source conditions. Our analysis does not require the regression function to be contained in the hypothesis class, and most notably does not employ the conventional \textit{a priori} assumptions on kernel eigendecay. Using the theory of interpolation, we demonstrate that the spectrum of the Mercer operator can be inferred in the presence of ``tight'' $L^{\infty}(\mathcal{X})$ embeddings of suitable Hilbert scales. Our analysis utilizes a new Fourier isocapacitary condition, which captures the interplay of the kernel Dirichlet capacities and small ball probabilities via the optimal Hilbert scale function.

📄 PDF Abstract BibTeX arXiv:2204.07856

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Optimal Rates of Sketched-regularized Algorithms for Least-Squares Regression over Hilbert Spaces

2018-03-12 · ICML 2018 7 · Junhong Lin, Volkan Cevher

We investigate regularized algorithms combining with projection for least-squares regression problem over a Hilbert space, covering nonparametric regression over a reproducing kernel Hilbert space. We prove convergence r…

regression

Optimal learning rates for least squares SVMs using Gaussian kernels

2011-12-01 · NeurIPS 2011 12 · Mona Eberts, Ingo Steinwart

We prove a new oracle inequality for support vector machines with Gaussian RBF kernels solving the regularized least squares regression problem. To this end, we apply the modulus of smoothness. With the help of the new o…

regression

Regularized least squares learning with heavy-tailed noise is minimax optimal

2025-05-20 · Mattes Mollenhauer, Nicole Mücke, Dimitri Meunier, Arthur Gretton

This paper examines the performance of ridge regression in reproducing kernel Hilbert spaces in the presence of noise that exhibits a finite number of higher moments. We establish excess risk bounds consisting of subgaus…

Analysis of Regularized Least Squares in Reproducing Kernel Krein Spaces

2020-06-01 · Fanghui Liu, Lei Shi, Xiaolin Huang, Jie Yang 외

In this paper, we study the asymptotic properties of regularized least squares with indefinite kernels in reproducing kernel Krein spaces (RKKS). By introducing a bounded hyper-sphere constraint to such non-convex regula…

Learning to Solve Linear Inverse Problems in Imaging with Neumann Networks

2019-09-14 · NeurIPS Workshop Deep_Invers 2019 12 · Greg Ongie, Davis Gilton, Rebecca Willett

Recent advances have illustrated that it is often possible to learn to solve linear inverse problems in imaging using training data that can outperform more traditional regularized least squares solutions. Along these li…