paper-with-me

Papers

Optimistic Bandit Convex Optimization

2016-12-01 · NeurIPS 2016 12 · Scott Yang, Mehryar Mohri

We introduce the general and powerful scheme of predicting information re-use in optimization algorithms. This allows us to devise a computationally efficient algorithm for bandit convex optimization with new state-of-the-art guarantees for both Lipschitz loss functions and loss functions with Lipschitz gradients. This is the first algorithm admitting both a polynomial time complexity and a regret that is polynomial in the dimension of the action space that improves upon the original regret bound for Lipschitz loss functions, achieving a regret of $\widetilde O(T^{11/16}d^{3/8})$. Our algorithm further improves upon the best existing polynomial-in-dimension bound (both computationally and in terms of regret) for loss functions with Lipschitz gradients, achieving a regret of $\widetilde O(T^{8/13} d^{5/3})$.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Variational Bayesian Optimistic Sampling

2021-10-29 · NeurIPS 2021 12 · Brendan O'Donoghue, Tor Lattimore

We consider online sequential decision problems where an agent must balance exploration and exploitation. We derive a set of Bayesian `optimistic' policies which, in the stochastic multi-armed bandit case, includes the T…

Thompson Sampling

Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions

2024-02-23 · Sungwoo Park, Junyeop Kwon, Byeongnoh Kim, Suhyun Chae 외

This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we…

Stochastic Optimization

Online Submodular Maximization via Online Convex Optimization

2023-09-08 · Tareq Si Salem, Gözde Özcan, Iasonas Nikolaou, Evimaria Terzi 외

We study monotone submodular maximization under general matroid constraints in the online setting. We prove that online optimization of a large class of submodular functions, namely, weighted threshold potential function…

Tractable Instances of Bilinear Maximization: Implementing LinUCB on Ellipsoids

2025-11-10 · Raymond Zhang, Hédi Hadiji, Richard Combes arxiv

We consider the maximization of $x^\top θ$ over $(x,θ) \in \mathcal{X} \times Θ$, with $\mathcal{X} \subset \mathbb{R}^d$ convex and $Θ\subset \mathbb{R}^d$ an ellipsoid. This problem is fundamental in linear bandits, as…

An Optimistic Algorithm for Online Convex Optimization with Adversarial Constraints

2024-12-11 · Jordan Lekeufack, Michael I. Jordan

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a …

Multi-Armed Bandits