paper-with-me

Papers

Generalized Linear Bandits with Local Differential Privacy

2021-06-07 · NeurIPS 2021 12 · Yuxuan Han, Zhipeng Liang, Yang Wang, Jiheng Zhang

Contextual bandit algorithms are useful in personalized online decision-making. However, many applications such as personalized medicine and online advertising require the utilization of individual-specific information for effective learning, while user's data should remain private from the server due to privacy concerns. This motivates the introduction of local differential privacy (LDP), a stringent notion in privacy, to contextual bandits. In this paper, we design LDP algorithms for stochastic generalized linear bandits to achieve the same regret bound as in non-privacy settings. Our main idea is to develop a stochastic gradient-based estimator and update mechanism to ensure LDP. We then exploit the flexibility of stochastic gradient descent (SGD), whose theoretical guarantee for bandit problems is rarely explored, in dealing with generalized linear bandits. We also develop an estimator and update mechanism based on Ordinary Least Square (OLS) for linear bandits. Finally, we conduct experiments with both simulation and real-world datasets to demonstrate the consistently superb performance of our algorithms under LDP constraints with reasonably small parameters $(\varepsilon, \delta)$ to ensure strong privacy protection.

📄 PDF Abstract BibTeX arXiv:2106.03365

Code (1)

liangzp/LDP-Bandit 공식 구현

Tasks

Decision MakingMulti-Armed Bandits

Similar Papers 제목 키워드 기반

Shuffle and Joint Differential Privacy for Generalized Linear Contextual Bandits

2026-01-31 · Sahasrajit Sarmasarkar arxiv

We present the first algorithms for generalized linear contextual bandits under shuffle differential privacy and joint differential privacy. While prior work on private contextual bandits has been restricted to linear re…

Locally Differentially Private (Contextual) Bandits Learning

2020-06-01 · NeurIPS 2020 12 · Kai Zheng, Tianle Cai, Weiran Huang, Zhenguo Li 외

We study locally differentially private (LDP) bandits learning in this paper. First, we propose simple black-box reduction frameworks that can solve a large family of context-free bandits learning problems with LDP guara…

Multi-Armed BanditsPrivacy Preserving Deep Learning

Differentially Private Linear Bandits with Partial Distributed Feedback

2022-07-12 · Fengjiao Li, Xingyu Zhou, Bo Ji

In this paper, we study the problem of global reward maximization with only partial distributed feedback. This problem is motivated by several real-world applications (e.g., cellular network configuration, dynamic pricin…

Robust and differentially private stochastic linear bandits

2023-04-23 · Vasileios Charisopoulos, Hossein Esfandiari, Vahab Mirrokni

In this paper, we study the stochastic linear bandit problem under the additional requirements of differential privacy, robustness and batched observations. In particular, we assume an adversary randomly chooses a consta…

Adversarial Robustness

Federated Linear Contextual Bandits with User-level Differential Privacy

2023-06-08 · Ruiquan Huang, Huanyu Zhang, Luca Melis, Milan Shen 외

This paper studies federated linear contextual bandits under the notion of user-level differential privacy (DP). We first introduce a unified federated bandits framework that can accommodate various definitions of DP in …

Decision MakingMulti-Armed BanditsSequential Decision Making