paper-with-me

홈 › Papers

On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence

2023-09-05 · NeurIPS 2023 11

Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies to name a few. Motivated by the data privacy concerns invoked by these applications, we study the problem of BAI with fixed confidence under $\epsilon$-global Differential Privacy (DP). First, to quantify the cost of privacy, we derive a lower bound on the sample complexity of any $\delta$-correct BAI algorithm satisfying $\epsilon$-global DP. Our lower bound suggests the existence of two privacy regimes depending on the privacy budget $\epsilon$. In the high-privacy regime (small $\epsilon$), the hardness depends on a coupled effect of privacy and a novel information-theoretic quantity, called the Total Variation Characteristic Time. In the low-privacy regime (large $\epsilon$), the sample complexity lower bound reduces to the classical non-private lower bound. Second, we propose AdaP-TT, an $\epsilon$-global DP variant of the Top Two algorithm. AdaP-TT runs in arm-dependent adaptive episodes and adds Laplace noise to ensure a good privacy-utility trade-off. We derive an asymptotic upper bound on the sample complexity of AdaP-TT that matches with the lower bound up to multiplicative constants in the high-privacy regime. Finally, we provide an experimental analysis of AdaP-TT that validates our theoretical results.

📄 PDF Abstract BibTeX arXiv:2309.02202

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Quantile Multi-Armed Bandits: Optimal Best-Arm Identification and a Differentially Private Scheme

2020-06-11 · Kontantinos E. Nikolakakis, Dionysios S. Kalogerias, Or Sheffet, Anand D. Sarwate

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we pro…

Multi-Armed Bandits

Differentially Private Best-Arm Identification

2024-06-10 · Achraf Azize, Marc Jourdan, Aymen Al Marjani, Debabrota Basu

Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies. Motivated by the data priva…

Fixed-Budget Differentially Private Best Arm Identification

2024-01-17 · Zhirui Chen, P. N. Karthik, Yeow Meng Chee, Vincent Y. F. Tan

We study best arm identification (BAI) in linear bandits in the fixed-budget regime under differential privacy constraints, when the arm rewards are supported on the unit interval. Given a finite budget $T$ and a privacy…

dpUGC: Learn Differentially Private Representation for User Generated Contents

2019-03-25 · Xuan-Son Vu, Son N. Tran, Lili Jiang

This paper firstly proposes a simple yet efficient generalized approach to apply differential privacy to text representation (i.e., word embedding). Based on it, we propose a user-level approach to learn personalized dif…

Efficient, Noise-Tolerant, and Private Learning via Boosting

2020-02-04 · Mark Bun, Marco Leandro Carmosino, Jessica Sorrell

We introduce a simple framework for designing private boosting algorithms. We give natural conditions under which these algorithms are differentially private, efficient, and noise-tolerant PAC learners. To demonstrate ou…