paper-with-me

홈 › Papers

Gaussian Imagination in Bandit Learning

2022-01-06 · Yueyang Liu, Adithya M. Devraj, Benjamin Van Roy, Kuang Xu

Assuming distributions are Gaussian often facilitates computations that are otherwise intractable. We study the performance of an agent that attains a bounded information ratio with respect to a bandit environment with a Gaussian prior distribution and a Gaussian likelihood function when applied instead to a Bernoulli bandit. Relative to an information-theoretic bound on the Bayesian regret the agent would incur when interacting with the Gaussian bandit, we bound the increase in regret when the agent interacts with the Bernoulli bandit. If the Gaussian prior distribution and likelihood function are sufficiently diffuse, this increase grows at a rate which is at most linear in the square-root of the time horizon, and thus the per-timestep increase vanishes. Our results formalize the folklore that so-called Bayesian agents remain effective when instantiated with diffuse misspecified distributions.

📄 PDF Abstract BibTeX arXiv:2201.01902

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Metadata-based Multi-Task Bandits with Bayesian Hierarchical Models

2021-08-13 · NeurIPS 2021 12 · Runzhe Wan, Lin Ge, Rui Song

How to explore efficiently is a central problem in multi-armed bandits. In this paper, we introduce the metadata-based multi-task bandit problem, where the agent needs to solve a large number of related multi-armed bandi…

Multi-Armed BanditsThompson Sampling

Thompson Sampling Regret Bounds for Contextual Bandits with sub-Gaussian rewards

2023-04-26 · Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund

In this work, we study the performance of the Thompson Sampling algorithm for Contextual Bandit problems based on the framework introduced by Neu et al. and their concept of lifted information ratio. First, we prove a co…

Multi-Armed BanditsThompson Sampling

Exploration Through Reward Biasing: Reward-Biased Maximum Likelihood Estimation for Stochastic Multi-Armed Bandits

2019-07-02 · Xi Liu, Ping-Chun Hsieh, Anirban Bhattacharya, P. R. Kumar

Inspired by the Reward-Biased Maximum Likelihood Estimate method of adaptive control, we propose RBMLE -- a novel family of learning algorithms for stochastic multi-armed bandits (SMABs). For a broad range of SMABs inclu…

Multi-Armed Bandits

Statistical Efficiency of Thompson Sampling for Combinatorial Semi-Bandits

2020-06-11 · NeurIPS 2020 12 · Pierre Perrault, Etienne Boursier, Vianney Perchet, Michal Valko

We investigate stochastic combinatorial multi-armed bandit with semi-bandit feedback (CMAB). In CMAB, the question of the existence of an efficient policy with an optimal asymptotic regret (up to a factor poly-logarithmi…

Thompson Sampling

Open Problem: Tight Bounds for Kernelized Multi-Armed Bandits with Bernoulli Rewards

2024-07-08 · Marco Mussi, Simone Drago, Alberto Maria Metelli

We consider Kernelized Bandits (KBs) to optimize a function $f : \mathcal{X} \rightarrow [0,1]$ belonging to the Reproducing Kernel Hilbert Space (RKHS) $\mathcal{H}_k$. Mainstream works on kernelized bandits focus on a …

Multi-Armed Bandits