paper-with-me

홈 › Papers

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

2015-02-23 · Sébastien Bubeck, Ofer Dekel, Tomer Koren, Yuval Peres

We analyze the minimax regret of the adversarial bandit convex optimization problem. Focusing on the one-dimensional case, we prove that the minimax regret is $\widetilde\Theta(\sqrt{T})$ and partially resolve a decade-old open problem. Our analysis is non-constructive, as we do not present a concrete algorithm that attains this regret rate. Instead, we use minimax duality to reduce the problem to a Bayesian setting, where the convex loss functions are drawn from a worst-case distribution, and then we solve the Bayesian version of the problem with a variant of Thompson Sampling. Our analysis features a novel use of convexity, formalized as a "local-to-global" property of convex functions, that may be of independent interest.

📄 PDF Abstract BibTeX arXiv:1502.06398

Code (0)

등록된 구현이 없습니다.

Tasks

Thompson Sampling

Similar Papers 제목 키워드 기반

Improved Regret for Bandit Convex Optimization with Delayed Feedback

2024-02-14 · Yuanyu Wan, Chang Yao, Mingli Song, Lijun Zhang

We investigate bandit convex optimization (BCO) with delayed feedback, where only the loss value of the action is revealed under an arbitrary delay. Let $n,T,\bar{d}$ denote the dimensionality, time horizon, and average …

Blocking

Linear Bandits on Uniformly Convex Sets

2021-03-10 · Thomas Kerdreux, Christophe Roux, Alexandre d'Aspremont, Sebastian Pokutta

Linear bandit algorithms yield $\tilde{\mathcal{O}}(n\sqrt{T})$ pseudo-regret bounds on compact convex action sets $\mathcal{K}\subset\mathbb{R}^n$ and two types of structural assumptions lead to better pseudo-regret bou…

Open-Ended Question Answering

A Reduction from Delayed to Immediate Feedback for Online Convex Optimization with Improved Guarantees

2026-02-02 · Alexander Ryabchenko, Idan Attias, Daniel M. Roy arxiv

We develop a reduction-based framework for online learning with delayed feedback that recovers and improves upon existing results for both first-order and bandit convex optimization. Our approach introduces a continuous-…

Optimal Regret Algorithm for Pseudo-1d Bandit Convex Optimization

2021-02-15 · Aadirupa Saha, Nagarajan Natarajan, Praneeth Netrapalli, Prateek Jain

We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the outpu…

Decision Making

Geometric Exploration for Online Control

2020-10-25 · NeurIPS 2020 12 · Orestis Plevrakis, Elad Hazan

We study the control of an \emph{unknown} linear dynamical system under general convex costs. The objective is minimizing regret vs. the class of disturbance-feedback-controllers, which encompasses all stabilizing linear…