paper-with-me

홈 › Papers

On the Optimal Regret of Locally Private Linear Contextual Bandit

2024-04-15 · Jiachun Li, David Simchi-Levi, Yining Wang

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual bandit algorithms, where sensitive information contained in contexts and rewards is protected against leakage to the general public. While the classical linear contextual bandit algorithm admits cumulative regret upper bounds of $\tilde O(\sqrt{T})$ via multiple alternative methods, it has remained open whether such regret bounds are attainable in the presence of local privacy constraints, with the state-of-the-art result being $\tilde O(T^{3/4})$. In this paper, we show that it is indeed possible to achieve an $\tilde O(\sqrt{T})$ regret upper bound for locally private linear contextual bandit. Our solution relies on several new algorithmic and analytical ideas, such as the analysis of mean absolute deviation errors and layered principal component regression in order to achieve small mean absolute deviation errors.

📄 PDF Abstract BibTeX arXiv:2404.09413

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Locally Differentially Private (Contextual) Bandits Learning

2020-06-01 · NeurIPS 2020 12 · Kai Zheng, Tianle Cai, Weiran Huang, Zhenguo Li 외

We study locally differentially private (LDP) bandits learning in this paper. First, we propose simple black-box reduction frameworks that can solve a large family of context-free bandits learning problems with LDP guara…

Multi-Armed BanditsPrivacy Preserving Deep Learning

Shuffle and Joint Differential Privacy for Generalized Linear Contextual Bandits

2026-01-31 · Sahasrajit Sarmasarkar arxiv

We present the first algorithms for generalized linear contextual bandits under shuffle differential privacy and joint differential privacy. While prior work on private contextual bandits has been restricted to linear re…

Near-Optimal Private Learning in Linear Contextual Bandits

2025-02-18 · Fan Chen, Jiachun Li, Alexander Rakhlin, David Simchi-Levi

We analyze the problem of private learning in generalized linear contextual bandits. Our approach is based on a novel method of re-weighted regression, yielding an efficient algorithm with regret of order $\sqrt{T}+\frac…

Multi-Armed Bandits

Differentially Private Contextual Linear Bandits

2018-09-28 · NeurIPS 2018 12 · Roshan Shariff, Or Sheffet

We study the contextual linear bandit problem, a version of the standard stochastic multi-armed bandit (MAB) problem where a learner sequentially selects actions to maximize a reward which depends also on a user provided…

Truthful mechanisms for linear bandit games with private contexts

2025-01-07 · Yiting Hu, Lingjie Duan

The contextual bandit problem, where agents arrive sequentially with personal contexts and the system adapts its arm allocation decisions accordingly, has recently garnered increasing attention for enabling more personal…

Thompson Sampling