paper-with-me

홈 › Papers

Differentially Private Best-Arm Identification

2024-06-10 · Achraf Azize, Marc Jourdan, Aymen Al Marjani, Debabrota Basu

Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies. Motivated by the data privacy concerns invoked by these applications, we study the problem of BAI with fixed confidence in both the local and central models, i.e. $\epsilon$-local and $\epsilon$-global Differential Privacy (DP). First, to quantify the cost of privacy, we derive lower bounds on the sample complexity of any $\delta$-correct BAI algorithm satisfying $\epsilon$-global DP or $\epsilon$-local DP. Our lower bounds suggest the existence of two privacy regimes. In the high-privacy regime, the hardness depends on a coupled effect of privacy and novel information-theoretic quantities involving the Total Variation. In the low-privacy regime, the lower bounds reduce to the non-private lower bounds. We propose $\epsilon$-local DP and $\epsilon$-global DP variants of a Top Two algorithm, namely CTB-TT and AdaP-TT*, respectively. For $\epsilon$-local DP, CTB-TT is asymptotically optimal by plugging in a private estimator of the means based on Randomised Response. For $\epsilon$-global DP, our private estimator of the mean runs in arm-dependent adaptive episodes and adds Laplace noise to ensure a good privacy-utility trade-off. By adapting the transportation costs, the expected sample complexity of AdaP-TT* reaches the asymptotic lower bound up to multiplicative constants.

📄 PDF Abstract BibTeX arXiv:2406.06408

Code (1)

achraf-azize/DP-BAI 공식 구현

Similar Papers 제목 키워드 기반

Quantile Multi-Armed Bandits: Optimal Best-Arm Identification and a Differentially Private Scheme

2020-06-11 · Kontantinos E. Nikolakakis, Dionysios S. Kalogerias, Or Sheffet, Anand D. Sarwate

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we pro…

Multi-Armed Bandits

dpUGC: Learn Differentially Private Representation for User Generated Contents

2019-03-25 · Xuan-Son Vu, Son N. Tran, Lili Jiang

This paper firstly proposes a simple yet efficient generalized approach to apply differential privacy to text representation (i.e., word embedding). Based on it, we propose a user-level approach to learn personalized dif…

An Easy-to-use and Robust Approach for the Differentially Private De-Identification of Clinical Textual Documents

2022-11-02 · Yakini Tchouka, Jean-François Couchot, David Laiymani

Unstructured textual data is at the heart of healthcare systems. For obvious privacy reasons, these documents are not accessible to researchers as long as they contain personally identifiable information. One way to shar…

De-identificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Projection-Free Bandit Optimization with Privacy Guarantees

2020-12-22 · Alina Ene, Huy L. Nguyen, Adrian Vladu

We design differentially private algorithms for the bandit convex optimization problem in the projection-free setting. This setting is important whenever the decision set has a complex geometry, and access to it is done …

Privately Learning Decision Lists and a Differentially Private Winnow

2026-02-07 · Mark Bun, William Fang arxiv

We give new differentially private algorithms for the classic problems of learning decision lists and large-margin halfspaces in the PAC and online models. In the PAC model, we give a computationally efficient algorithm …