paper-with-me

홈 › Papers

Strategic PAC Learnability via Geometric Definability

2026-05-13 · Yuval Filmus, Shay Moran, Elizaveta Nesterova, Nir Rosenfeld, Alexander Shlimovich arxiv

Strategic classification studies learning settings in which individuals can modify their features, at a cost, in order to influence the classifier's decision. A central question is how the sample complexity of the induced (strategic) hypothesis class depends on the complexities of the underlying hypothesis class and the cost structure governing feasible manipulations. Prior work has shown that in several natural settings, such as linear classifiers with norm costs, the induced complexity can be controlled. We begin by showing that such guarantees fail in general - even in simple cases: there exist hypothesis classes of VC dimension $1$ on the real line such that, even under the simplest interval neighborhoods, the induced class has infinite VC dimension. Thus, strategic behavior can turn an easy learning problem into a non-learnable one. To overcome this, we introduce structure via a geometric definability assumption: both the hypothesis class and the cost-induced neighborhood relation can be defined by first-order formulas over $\mathbb{R}_{\mathtt{exp}}$. Intuitively, this means that hypotheses and costs can be described using arithmetic operations, exponentiation, logarithms, and comparisons. This captures a broad range of natural classes and cost functions, including $\ell_p$ distances, Wasserstein distance, and information-theoretic divergences. Under this assumption, we prove that learnability is preserved, with sample complexity controlled by the complexity of the defining formulas.

📄 PDF Abstract BibTeX arXiv:2605.13426

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

PAC-Learning for Strategic Classification

2020-12-06 · Ravi Sundaram, Anil Vullikanti, Haifeng Xu, Fan Yao

The study of strategic or adversarial manipulation of testing data to fool a classifier has attracted much recent attention. Most previous works have focused on two extreme situations where any testing data point either …

ClassificationGeneral ClassificationPAC learning

Truth Set Algebra: A New Way to Prove Undefinability

2022-08-08 · Sophia Knight, Pavel Naumov, Qi Shi, Vigasan Suntharraj

The article proposes a new technique for proving the undefinability of logical connectives through each other and illustrates the technique with several examples. Some of the obtained results are new proofs of the existi…

Learnability Gaps of Strategic Classification

2024-02-29 · Lee Cohen, Yishay Mansour, Shay Moran, Han Shao

In contrast with standard classification tasks, strategic classification involves agents strategically modifying their features in an effort to receive favorable predictions. For instance, given a classifier determining …

ClassificationMulti-Label Learning

Non-characterizability of belief revision: an application of finite model theory

2014-03-25 · Gyorgy Turan, Jon Yaggie

A formal framework is given for the characterizability of a class of belief revision operators, defined using minimization over a class of partial preorders, by postulates. It is shown that for partial orders characteriz…

Machine Learning for Strategic Inference

2021-01-24 · In-Koo Cho, Jonathan Libgober

We study interactions between strategic players and markets whose behavior is guided by an algorithm. Algorithms use data from prior interactions and a limited set of decision rules to prescribe actions. While as-if rati…

BIG-bench Machine Learning