paper-with-me

홈 › Papers

Adaptive and oblivious statistical adversaries are equivalent

2024-10-17 · Guy Blanc, Gregory Valiant

We resolve a fundamental question about the ability to perform a statistical task, such as learning, when an adversary corrupts the sample. Such adversaries are specified by the types of corruption they can make and their level of knowledge about the sample. The latter distinguishes between sample-adaptive adversaries which know the contents of the sample when choosing the corruption, and sample-oblivious adversaries, which do not. We prove that for all types of corruptions, sample-adaptive and sample-oblivious adversaries are \emph{equivalent} up to polynomial factors in the sample size. This resolves the main open question introduced by \cite{BLMT22} and further explored in \cite{CHLLN23}. Specifically, consider any algorithm $A$ that solves a statistical task even when a sample-oblivious adversary corrupts its input. We show that there is an algorithm $A'$ that solves the same task when the corresponding sample-adaptive adversary corrupts its input. The construction of $A'$ is simple and maintains the computational efficiency of $A$: It requests a polynomially larger sample than $A$ uses and then runs $A$ on a uniformly random subsample. One of our main technical tools is a new structural result relating two distributions defined on sunflowers which may be of independent interest.

📄 PDF Abstract BibTeX arXiv:2410.13548

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

On the power of adaptivity in statistical adversaries

2021-11-19 · Guy Blanc, Jane Lange, Ali Malik, Li-Yang Tan

We study a fundamental question concerning adversarial noise models in statistical problems where the algorithm receives i.i.d. draws from a distribution $\mathcal{D}$. The definitions of these adversaries specify the ty…

All

On the Learnability of Distribution Classes with Adaptive Adversaries

2025-09-05 · Tosca Lechner, Alex Bie, Gautam Kamath arxiv

We consider the question of learnability of distribution classes in the presence of adaptive adversaries -- that is, adversaries capable of intercepting the samples requested by a learner and applying manipulations with …

Bandit-Feedback Online Multiclass Classification: Variants and Tradeoffs

2024-02-12 · Yuval Filmus, Steve Hanneke, Idan Mehalel, Shay Moran

Consider the domain of multiclass classification within the adversarial online setting. What is the price of relying on bandit feedback as opposed to full information? To what extent can an adaptive adversary amplify the…

Classification

Tracking the Best Expert Privately

2025-03-12 · Aadirupa Saha, Vinod Raman, Hilal Asi

We design differentially private algorithms for the problem of prediction with expert advice under dynamic regret, also known as tracking the best expert. Our work addresses three natural types of adversaries, stochastic…

Private Online Prediction from Experts: Separations and Faster Rates

2022-10-24 · Hilal Asi, Vitaly Feldman, Tomer Koren, Kunal Talwar

Online prediction from experts is a fundamental problem in machine learning and several works have studied this problem under privacy constraints. We propose and analyze new algorithms for this problem that improve over …