paper-with-me

Papers

Learning linear operators: Infinite-dimensional regression as a well-behaved non-compact inverse problem

2022-11-16 · Mattes Mollenhauer, Nicole Mücke, T. J. Sullivan

We consider the problem of learning a linear operator $\theta$ between two Hilbert spaces from empirical observations, which we interpret as least squares regression in infinite dimensions. We show that this goal can be reformulated as an inverse problem for $\theta$ with the feature that its forward operator is generally non-compact (even if $\theta$ is assumed to be compact or of $p$-Schatten class). However, we prove that, in terms of spectral properties and regularisation theory, this inverse problem is equivalent to the known compact inverse problem associated with scalar response regression. Our framework allows for the elegant derivation of dimension-free rates for generic learning algorithms under H\"older-type source conditions. The proofs rely on the combination of techniques from kernel regression with recent results on concentration of measure for sub-exponential Hilbertian random variables. The obtained rates hold for a variety of practically-relevant scenarios in functional regression as well as nonlinear regression with operator-valued kernels and match those of classical kernel regression with scalar response.

📄 PDF Abstract BibTeX arXiv:2211.08875

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Online Infinite-Dimensional Regression: Learning Linear Operators

2023-09-08 · Vinod Raman, Unique Subedi, Ambuj Tewari

We consider the problem of learning linear operators under squared loss between two infinite-dimensional Hilbert spaces in the online setting. We show that the class of linear operators with uniformly bounded $p$-Schatte…

regression

Learning Schatten--von Neumann Operators

2019-01-29 · Puoya Tabaghi, Maarten de Hoop, Ivan Dokmanić

We study the learnability of a class of compact operators known as Schatten--von Neumann operators. These operators between infinite-dimensional function spaces play a central role in a variety of applications in learnin…

Learning Theory

Nonparametric Control Koopman Operators

2024-05-12 · Petar Bevanda, Bas Driessen, Lucian Cristian Iacob, Stefan Sosnowski 외

This paper presents a novel Koopman (composition) operator representation framework for control systems in reproducing kernel Hilbert spaces (RKHSs) that is free of explicit dictionary or input parametrizations. By estab…

Learning TheoryModel Predictive ControlOperator learning

Optimal Multiscale Learning of Linear Operators

2026-06-15 · Jiaheng Chen, Daniel Sanz-Alonso arxiv

We study the statistical and computational limits of learning bounded linear operators between Sobolev spaces from noisy input-output data. In wavelet coordinates, the problem is recast as an infinite-dimensional matrix …

Regularised Least-Squares Regression with Infinite-Dimensional Output Space

2020-10-21 · Junhyunng Park, Krikamol Muandet

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibl…

Learning Theoryregression