paper-with-me

Papers

Convergence Rates for Learning Linear Operators from Noisy Data

2021-08-27 · Maarten V. de Hoop, Nikola B. Kovachki, Nicholas H. Nelsen, Andrew M. Stuart

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear operator. Assuming that the operator is diagonalizable in a known basis, this work solves the equivalent inverse problem of estimating the operator's eigenvalues given the data. Adopting a Bayesian approach, the theoretical analysis establishes posterior contraction rates in the infinite data limit with Gaussian priors that are not directly linked to the forward map of the inverse problem. The main results also include learning-theoretic generalization error guarantees for a wide range of distribution shifts. These convergence rates quantify the effects of data smoothness and true eigenvalue decay or growth, for compact or unbounded operators, respectively, on sample complexity. Numerical evidence supports the theory in diagonal and non-diagonal settings.

📄 PDF Abstract BibTeX arXiv:2108.12515

Code (0)

등록된 구현이 없습니다.

Tasks

Learning Theory

Similar Papers 제목 키워드 기반

Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity

2024-01-23 · Thinh T. Doan

This paper proposes to develop a new variant of the two-time-scale stochastic approximation to find the roots of two coupled nonlinear operators, assuming only noisy samples of these operators can be observed. Our key id…

Kernel spectral joint embeddings for high-dimensional noisy datasets using duo-landmark integral operators

2024-05-20 · Xiucai Ding, Rong Ma

Integrative analysis of multiple heterogeneous datasets has become standard practice in many research fields, especially in single-cell genomics and medical informatics. Existing approaches oftentimes suffer from limited…

Data VisualizationDenoising

Online Infinite-Dimensional Regression: Learning Linear Operators

2023-09-08 · Vinod Raman, Unique Subedi, Ambuj Tewari

We consider the problem of learning linear operators under squared loss between two infinite-dimensional Hilbert spaces in the online setting. We show that the class of linear operators with uniformly bounded $p$-Schatte…

regression

Finite-Time Convergence Rates of Nonlinear Two-Time-Scale Stochastic Approximation under Markovian Noise

2021-04-04 · Thinh T. Doan

We study the so-called two-time-scale stochastic approximation, a simulation-based approach for finding the roots of two coupled nonlinear operators. Our focus is to characterize its finite-time performance in a Markov s…

Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems

2025-10-25 · Sayantan Choudhury, Nicolas Loizou arxiv

Introduced by Korpelevich in 1976, the extragradient method (EG) has become a cornerstone technique for solving min-max optimization, root-finding problems, and variational inequalities (VIs). Despite its longstanding pr…