paper-with-me

홈 › Papers

Smoothed Agnostic Learning of Halfspaces over the Hypercube

2025-11-21 · Yiwen Kou, Raghu Meka arxiv

Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such hardness, but existing frameworks rely on additive Gaussian perturbations, making them unsuitable for discrete domains. We introduce a new smoothed agnostic learning framework for Boolean inputs, where perturbations are modeled via random bit flips. This defines a natural discrete analogue of smoothed optimality generalizing the Gaussian case. Under strictly subexponential assumptions on the input distribution, we give an efficient algorithm for learning halfspaces in this model, with runtime and sample complexity approximately n raised to a poly(1/(sigma * epsilon)) factor. Previously, such algorithms were known only with strong structural assumptions for the discrete hypercube, for example, independent coordinates or symmetric distributions. Our result provides the first computationally efficient guarantee for smoothed agnostic learning of halfspaces over the Boolean hypercube, bridging the gap between worst-case intractability and practical learnability in discrete settings.

📄 PDF Abstract BibTeX arXiv:2511.17782

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Statistical Query Lower Bounds for Smoothed Agnostic Learning

2026-02-24 · Ilias Diakonikolas, Daniel M. Kane arxiv

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Sp…

A Near-optimal SQ Lower Bound for Smoothed Agnostic Learning of Boolean Halfspaces

2026-05-04 · Tim Sinen arxiv

We study the complexity of smoothed agnostic learning of halfspaces on $\{\pm 1\}^n$ under uniform marginals in the model of~\cite{KM25}, where each input coordinate is independently flipped with probability $σ\in (0, {1…

A Fully Polynomial-Time Algorithm for Robustly Learning Halfspaces over the Hypercube

2025-11-10 · Gautam Chandrasekaran, Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan arxiv

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of exampl…

Smoothed Analysis for Learning Concepts with Low Intrinsic Dimension

2024-07-01 · Gautam Chandrasekaran, Adam Klivans, Vasilis Kontonis, Raghu Meka 외

In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $\…

Agnostic Proper Learning of Halfspaces under Gaussian Marginals

2021-02-10 · Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos 외

We study the problem of agnostically learning halfspaces under the Gaussian distribution. Our main result is the {\em first proper} learning algorithm for this problem whose sample complexity and computational complexity…

regression