paper-with-me

Papers

Multi-Agent Best Arm Identification in Stochastic Linear Bandits

2024-11-20 · Sanjana Agrawal, Saúl A. Blanco

We study the problem of collaborative best-arm identification in stochastic linear bandits under a fixed-budget scenario. In our learning model, we consider multiple agents connected through a star network or a generic network, interacting with a linear bandit instance in parallel. The objective of the agents is to collaboratively learn the best arm of the given bandit instance with the help of a central server while minimizing the probability of error in best arm estimation. For this purpose, we devise the algorithms MaLinBAI-Star and MaLinBAI-Gen for star networks and generic networks respectively. Both algorithms employ an Upper-Confidence-Bound approach where agents share their knowledge through the central server during each communication round. We demonstrate, both theoretically and empirically, that our algorithms enjoy exponentially decaying probability of error in the allocated time budget. Furthermore, experimental results based on synthetic and real-world data validate the effectiveness of our algorithms over the existing multi-agent algorithms.

📄 PDF Abstract BibTeX arXiv:2411.13690

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Choosing Answers in $\varepsilon$-Best-Answer Identification for Linear Bandits

2022-06-09 · Marc Jourdan, Rémy Degenne

In pure-exploration problems, information is gathered sequentially to answer a question on the stochastic environment. While best-arm identification for linear bandits has been extensively studied in recent years, few wo…

Near Optimal Best Arm Identification for Clustered Bandits

2025-05-15 · Yash, Nikhil Karamchandani, Avishek Ghosh

This work investigates the problem of best arm identification for multi-agent multi-armed bandits. We consider $N$ agents grouped into $M$ clusters, where each cluster solves a stochastic bandit problem. The mapping betw…

ClusteringComputational EfficiencyMulti-Armed Bandits

Distributed System Identification for Linear Stochastic Systems with Binary Sensors

2021-08-03 · Kewei Fu, Han-Fu Chen, Wenxiao Zhao

The problem of distributed identification of linear stochastic system with unknown coefficients over time-varying networks is considered. For estimating the unknown coefficients, each agent in the network can only access…

Distributed Optimization

Price of Safety in Linear Best Arm Identification

2023-09-15 · Xuedong Shang, Igor Colin, Merwan Barlier, Hamza Cherkaoui

We introduce the safe best-arm identification framework with linear feedback, where the agent is subject to some stage-wise safety constraint that linearly depends on an unknown parameter vector. The agent must take acti…

Optimal Best-arm Identification in Linear Bandits

2020-06-29 · NeurIPS 2020 12 · Yassir Jedra, Alexandre Proutiere

We study the problem of best-arm identification with fixed confidence in stochastic linear bandits. The objective is to identify the best arm with a given level of certainty while minimizing the sampling budget. We devis…