paper-with-me

Papers

A Parallel algorithm for $\mathcal{X}$-Armed bandits

2015-10-26 · Cheng Chen, Shuang Liu, Zhihua Zhang, Wu-Jun Li

The target of $\mathcal{X}$-armed bandit problem is to find the global maximum of an unknown stochastic function $f$, given a finite budget of $n$ evaluations. Recently, $\mathcal{X}$-armed bandits have been widely used in many situations. Many of these applications need to deal with large-scale data sets. To deal with these large-scale data sets, we study a distributed setting of $\mathcal{X}$-armed bandits, where $m$ players collaborate to find the maximum of the unknown function. We develop a novel anytime distributed $\mathcal{X}$-armed bandit algorithm. Compared with prior work on $\mathcal{X}$-armed bandits, our algorithm uses a quite different searching strategy so as to fit distributed learning scenarios. Our theoretical analysis shows that our distributed algorithm is $m$ times faster than the classical single-player algorithm. Moreover, the number of communication rounds of our algorithm is only logarithmic in $mn$. The numerical results show that our method can make effective use of every players to minimize the loss. Thus, our distributed approach is attractive and useful.

📄 PDF Abstract BibTeX arXiv:1510.07471

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Stochastic Bandits with Linear Constraints

2020-06-17 · Aldo Pacchiano, Mohammad Ghavamzadeh, Peter Bartlett, Heinrich Jiang

We study a constrained contextual linear bandit setting, where the goal of the agent is to produce a sequence of policies, whose expected cumulative reward over the course of $T$ rounds is maximum, and each has an expect…

Multi-Armed Bandits

Correlated Multi-armed Bandits with a Latent Random Source

2018-08-17 · Samarth Gupta, Gauri Joshi, Osman Yağan

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used t…

Multi-Armed Bandits

Best-Arm Identification in Correlated Multi-Armed Bandits

2021-09-10 · Samarth Gupta, Gauri Joshi, Osman Yağan

In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the hi…

Multi-Armed Bandits

Open Problem: Tight Bounds for Kernelized Multi-Armed Bandits with Bernoulli Rewards

2024-07-08 · Marco Mussi, Simone Drago, Alberto Maria Metelli

We consider Kernelized Bandits (KBs) to optimize a function $f : \mathcal{X} \rightarrow [0,1]$ belonging to the Reproducing Kernel Hilbert Space (RKHS) $\mathcal{H}_k$. Mainstream works on kernelized bandits focus on a …

Multi-Armed Bandits

Constrained Feedback Learning for Non-Stationary Multi-Armed Bandits

2025-09-18 · Shaoang Li, Jian Li arxiv

Non-stationary multi-armed bandits enable agents to adapt to changing environments by incorporating mechanisms to detect and respond to shifts in reward distributions, making them well-suited for dynamic settings. Howeve…

Multi-Armed Bandits