paper-with-me

홈 › Papers

Convex Methods for Constrained Linear Bandits

2023-11-07 · Amirhossein Afsharrad, Ahmadreza Moradipari, Sanjay Lall

Recently, bandit optimization has received significant attention in real-world safety-critical systems that involve repeated interactions with humans. While there exist various algorithms with performance guarantees in the literature, practical implementation of the algorithms has not received as much attention. This work presents a comprehensive study on the computational aspects of safe bandit algorithms, specifically safe linear bandits, by introducing a framework that leverages convex programming tools to create computationally efficient policies. In particular, we first characterize the properties of the optimal policy for safe linear bandit problem and then propose an end-to-end pipeline of safe linear bandit algorithms that only involves solving convex problems. We also numerically evaluate the performance of our proposed methods.

📄 PDF Abstract BibTeX arXiv:2311.04338

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Comparator-adaptive Convex Bandits

2020-07-16 · NeurIPS 2020 12 · Dirk van der Hoeven, Ashok Cutkosky, Haipeng Luo

We study bandit convex optimization methods that adapt to the norm of the comparator, a topic that has only been studied before for its full-information counterpart. Specifically, we develop convex bandit algorithms with…

A Regularized Online Newton Method for Stochastic Convex Bandits with Linear Vanishing Noise

2025-01-19 · Jingxin Zhan, Yuchen Xin, Kaicheng Jin, Zhihua Zhang

We study a stochastic convex bandit problem where the subgaussian noise parameter is assumed to decrease linearly as the learner selects actions closer and closer to the minimizer of the convex loss function. Accordingly…

A conversion theorem and minimax optimality for continuum contextual bandits

2024-06-09 · Arya Akhavan, Karim Lounici, Massimiliano Pontil, Alexandre B. Tsybakov

We study the contextual continuum bandits problem, where the learner sequentially receives a side information vector and has to choose an action in a convex set, minimizing a function associated with the context. The goa…

Multi-Armed Bandits

Corralling a Larger Band of Bandits: A Case Study on Switching Regret for Linear Bandits

2022-02-12 · Haipeng Luo, Mengxiao Zhang, Peng Zhao, Zhi-Hua Zhou

We consider the problem of combining and learning over a set of adversarial bandit algorithms with the goal of adaptively tracking the best one on the fly. The CORRAL algorithm of Agarwal et al. (2017) and its variants (…

Locally Differentially Private (Contextual) Bandits Learning

2020-06-01 · NeurIPS 2020 12 · Kai Zheng, Tianle Cai, Weiran Huang, Zhenguo Li 외

We study locally differentially private (LDP) bandits learning in this paper. First, we propose simple black-box reduction frameworks that can solve a large family of context-free bandits learning problems with LDP guara…

Multi-Armed BanditsPrivacy Preserving Deep Learning