paper-with-me

홈 › Papers

Robust Stochastic Linear Contextual Bandits Under Adversarial Attacks

2021-06-05 · Qin Ding, Cho-Jui Hsieh, James Sharpnack

Stochastic linear contextual bandit algorithms have substantial applications in practice, such as recommender systems, online advertising, clinical trials, etc. Recent works show that optimal bandit algorithms are vulnerable to adversarial attacks and can fail completely in the presence of attacks. Existing robust bandit algorithms only work for the non-contextual setting under the attack of rewards and cannot improve the robustness in the general and popular contextual bandit environment. In addition, none of the existing methods can defend against attacked context. In this work, we provide the first robust bandit algorithm for stochastic linear contextual bandit setting under a fully adaptive and omniscient attack with sub-linear regret. Our algorithm not only works under the attack of rewards, but also under attacked context. Moreover, it does not need any information about the attack budget or the particular form of the attack. We provide theoretical guarantees for our proposed algorithm and show by experiments that our proposed algorithm improves the robustness against various kinds of popular attacks.

📄 PDF Abstract BibTeX arXiv:2106.02978

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Armed BanditsRecommendation Systems

Similar Papers 제목 키워드 기반

Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithms

2022-11-08 · Osama A. Hanna, Lin F. Yang, Christina Fragouli

In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified…

Multi-Armed Bandits

Best-of-Both-Worlds Linear Contextual Bandits

2023-12-27 · Masahiro Kato, Shinji Ito

This study investigates the problem of $K$-armed linear contextual bandits, an instance of the multi-armed bandit problem, under an adversarial corruption. At each round, a decision-maker observes an independent and iden…

Multi-Armed Bandits

Contextual Multinomial Logit Bandits with General Value Functions

2024-02-12 · Mengxiao Zhang, Haipeng Luo

Contextual multinomial logit (MNL) bandits capture many real-world assortment recommendation problems such as online retailing/advertising. However, prior work has only considered (generalized) linear value functions, wh…

Computational EfficiencyMulti-Armed Bandits

An Improved Algorithm for Adversarial Linear Contextual Bandits via Reduction

2025-08-16 · Tim van Erven, Jack Mayo, Julia Olkhovskaya, Chen-Yu Wei arxiv

We present an oracle-efficient, near-optimal algorithm for linear contextual bandits with adversarial losses and stochastic action sets, only requiring a linear optimization oracle for the action sets in each round. Our …

Meta-LinEXP3: Online-within-Online Learning for Adversarial Linear Contextual Bandits

2026-09-09 · Hao Li, Jie Xu, Zheng Xie arxiv

Meta-learning has emerged as an effective paradigm for transferring knowledge across sequential bandit tasks. While substantial progress has been made for stochastic bandits and non-contextual adversarial bandits, meta-l…