paper-with-me

Papers

Federated Linear Contextual Bandits with Heterogeneous Clients

2024-02-29 · Ethan Blaser, Chuanhao Li, Hongning Wang

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private, efficient, and decentralized online learning. However, almost all previous works rely on strong assumptions of client homogeneity, i.e., all participating clients shall share the same bandit model; otherwise, they all would suffer linear regret. This greatly restricts the application of federated bandit learning in practice. In this work, we introduce a new approach for federated bandits for heterogeneous clients, which clusters clients for collaborative bandit learning under the federated learning setting. Our proposed algorithm achieves non-trivial sub-linear regret and communication cost for all clients, subject to the communication protocol under federated learning that at anytime only one model can be shared by the server.

📄 PDF Abstract BibTeX arXiv:2403.00116

Code (0)

등록된 구현이 없습니다.

Tasks

AllFederated LearningMulti-Armed Bandits

Similar Papers 제목 키워드 기반

Asynchronous Upper Confidence Bound Algorithms for Federated Linear Bandits

2021-10-04 · Chuanhao Li, Hongning Wang

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, h…

Federated Learning

Federated Linear Contextual Bandits

2021-10-27 · NeurIPS 2021 12 · Ruiquan Huang, Weiqiang Wu, Jing Yang, Cong Shen

This paper presents a novel federated linear contextual bandits model, where individual clients face different $K$-armed stochastic bandits coupled through common global parameters. By leveraging the geometric structure …

Multi-Armed Bandits

Federated Linear Contextual Bandits with User-level Differential Privacy

2023-06-08 · Ruiquan Huang, Huanyu Zhang, Luca Melis, Milan Shen 외

This paper studies federated linear contextual bandits under the notion of user-level differential privacy (DP). We first introduce a unified federated bandits framework that can accommodate various definitions of DP in …

Decision MakingMulti-Armed BanditsSequential Decision Making

Federated Linear Bandits with Finite Adversarial Actions

2023-11-02 · NeurIPS 2023 11

We study a federated linear bandits model, where $M$ clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that may be different across clients. To add…

Multi-Armed Bandits

Federated Online Sparse Decision Making

2022-02-27 · Chi-Hua Wang, Wenjie Li, Guang Cheng, Guang Lin

This paper presents a novel federated linear contextual bandits model, where individual clients face different K-armed stochastic bandits with high-dimensional decision context and coupled through common global parameter…

Decision MakingMulti-Armed Bandits