paper-with-me

홈 › Papers

Towards Sharp Minimax Risk Bounds for Operator Learning

2025-12-19 · Ben Adcock, Gregor Maier, Rahul Parhi arxiv

We develop a minimax theory for operator learning, where the goal is to estimate an unknown operator between separable Hilbert spaces from finitely many noisy input-output samples. For uniformly bounded Lipschitz operators, we prove information-theoretic lower bounds together with matching or near-matching upper bounds, covering both fixed and random designs under Hilbert-valued Gaussian noise and Gaussian white noise errors. The rates are controlled by the spectrum of the covariance operator of the measure that defines the error metric. Our setup is very general and allows for measures with unbounded support. A key implication is a curse of sample complexity, which shows that the minimax risk for generic Lipschitz operators cannot decay at any algebraic rate in the sample size. We obtain sharp characterizations when the covariance spectrum decays exponentially and provide general upper and lower bounds in slower-decay regimes. Finally, we show that assuming higher regularity, i.e., Hölder smoothness, does not improve minimax rates over the Lipschitz case, up to potential constants. Thus, we show that learning operators of any finite regularity necessarily suffers a curse of sample complexity.

📄 PDF Abstract BibTeX arXiv:2512.17805

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Sharper Risk Bounds for Minimax Problems

2024-10-11 · Bowei Zhu, Shaojie Li, Yong liu

Minimax problems have achieved success in machine learning such as adversarial training, robust optimization, reinforcement learning. For theoretical analysis, current optimal excess risk bounds, which are composed by ge…

Generalization Bounds

Non asymptotic estimation lower bounds for LTI state space models with Cramér-Rao and van Trees

2021-09-17 · Boualem Djehiche, Othmane Mazhar

We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean …

State Space Models

Sharp Generalization of Transductive Learning: A Transductive Local Rademacher Complexity Approach

2023-09-28 · Yingzhen Yang

We introduce a new tool, Transductive Local Complexity (TLC), designed to analyze the generalization performance of transductive learning methods and inspire the development of new algorithms in this domain. Our work ext…

Generalization BoundsLearning TheoryTransductive Learning

Minimax Excess Risk of First-Order Methods for Statistical Learning with Data-Dependent Oracles

2023-07-10 · Kevin Scaman, Mathieu Even, Batiste Le Bars, Laurent Massoulié

In this paper, our aim is to analyse the generalization capabilities of first-order methods for statistical learning in multiple, different yet related, scenarios including supervised learning, transfer learning, robust …

Federated Learningparameter estimationQuantizationTransfer Learning

Minimax Rates for the Estimation of Eigenpairs of Weighted Laplace-Beltrami Operators on Manifolds

2025-05-30 · Nicolás García Trillos, Chenghui Li, Raghavendra Venkatraman

We study the problem of estimating eigenpairs of elliptic differential operators from samples of a distribution $\rho$ supported on a manifold $M$. The operators discussed in the paper are relevant in unsupervised learni…

Density Estimation