paper-with-me

Papers

Tight $L_\infty$ Sample Complexity for Low-Degree and Sparse Boolean Polynomials

2026-06-15 · Jasper van Doornmalen, Mathieu Molina, Victor Verdugo, José Verschae arxiv

Motivated by the optimization of bounded binary black-box functions, we study the problem of learning polynomial surrogates over the Boolean hypercube. To ensure that optimizing the surrogate yields good solutions for the underlying objective, we require uniform $L_\infty$-error guarantees rather than the usual $L_2$-type guarantees. We characterize the minimax sample complexity of uniform estimation under subgaussian noise for two classes of bounded polynomials. First, for polynomials of degree at most $d$ on $n$ variables, the sample complexity scales as $n^{d+1}$. Second, for $s$-sparse Fourier-Walsh polynomials with $s \leq n$, it scales as $ns^2$. These rates differ structurally from the noiseless setting, where uniform exact recovery scales as $n^d$ and $ns$, respectively. Our lower bounds hold even for arbitrary adaptive learners, showing that the additional factors are intrinsic to the noisy cases. Standard Fourier-analysis tools for the $L_2$-norm do not naturally extend to the $L_\infty$-setting in a way that yields uniform guarantees. Our proofs overcome this difficulty by relying on suitably chosen auxiliary norms that serve as proxies for controlling the $L_\infty$-error. Together, our results provide a tight characterization of the sample complexity of learning optimization-safe polynomial surrogates.

📄 PDF Abstract BibTeX arXiv:2606.17319

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Toward $L_\infty$-recovery of Nonlinear Functions: A Polynomial Sample Complexity Bound for Gaussian Random Fields

2023-04-29 · Kefan Dong, Tengyu Ma

Many machine learning applications require learning a function with a small worst-case error over the entire input domain, that is, the $L_\infty$-error, whereas most existing theoretical works only guarantee recovery in…

Understanding Sparse JL for Feature Hashing

2019-03-08 · NeurIPS 2019 12 · Meena Jagadeesan

Feature hashing and other random projection schemes are commonly used to reduce the dimensionality of feature vectors. The goal is to efficiently project a high-dimensional feature vector living in $\mathbb{R}^n$ into a …

Lipschitz constant estimation of Neural Networks via sparse polynomial optimization

2020-04-18 · ICLR 2020 1 · Fabian Latorre, Paul Rolland, Volkan Cevher

We introduce LiPopt, a polynomial optimization framework for computing increasingly tighter upper bounds on the Lipschitz constant of neural networks. The underlying optimization problems boil down to either linear (LP) …

Instance-optimal high-precision shadow tomography with few-copy measurements: A metrological approach

2026-02-04 · Senrui Chen, Weiyuan Gong, Sisi Zhou arxiv

We study the sample complexity of shadow tomography in the high-precision regime under realistic measurement constraints. Given an unknown $d$-dimensional quantum state $ρ$ and a known set of observables $\{O_i\}_{i=1}^m…

Information Theoretic Optimal Learning of Gaussian Graphical Models

2017-03-15 · Sidhant Misra, Marc Vuffray, Andrey Y. Lokhov

What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples neces…

Graph Reconstruction