paper-with-me

홈 › Papers

Sharp bounds on the price of bandit feedback for several models of mistake-bounded online learning

2022-09-03 · Raymond Feng, Jesse Geneson, Andrew Lee, Espen Slettnes

We determine sharp bounds on the price of bandit feedback for several variants of the mistake-bound model. The first part of the paper presents bounds on the $r$-input weak reinforcement model and the $r$-input delayed, ambiguous reinforcement model. In both models, the adversary gives $r$ inputs in each round and only indicates a correct answer if all $r$ guesses are correct. The only difference between the two models is that in the delayed, ambiguous model, the learner must answer each input before receiving the next input of the round, while the learner receives all $r$ inputs at once in the weak reinforcement model. In the second part of the paper, we introduce models for online learning with permutation patterns, in which a learner attempts to learn a permutation from a set of permutations by guessing statistics related to sub-permutations. For these permutation models, we prove sharp bounds on the price of bandit feedback.

📄 PDF Abstract BibTeX arXiv:2209.01366

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bounds on the price of feedback for mistake-bounded online learning

2024-01-11 · Jesse Geneson, Linus Tang

We improve several worst-case bounds for various online learning scenarios from (Auer and Long, Machine Learning, 1999). In particular, we sharpen an upper bound for delayed ambiguous reinforcement learning by a factor o…

reinforcement-learningReinforcement Learning

Algorithmic Chaining and the Role of Partial Feedback in Online Nonparametric Learning

2017-02-27 · Nicolò Cesa-Bianchi, Pierre Gaillard, Claudio Gentile, Sébastien Gerchinovitz

We investigate contextual online learning with nonparametric (Lipschitz) comparison classes under different assumptions on losses and feedback information. For full information feedback and Lipschitz losses, we design th…

Fast Rates for Bandit PAC Multiclass Classification

2024-06-18 · Liad Erez, Alon Cohen, Tomer Koren, Yishay Mansour 외

We study multiclass PAC learning with bandit feedback, where inputs are classified into one of $K$ possible labels and feedback is limited to whether or not the predicted labels are correct. Our main contribution is in d…

ClassificationPAC learningStochastic Optimization

Near-Optimal Stochastic Linear Bandits with Delay

2026-06-15 · Ofir Schlisselberg, Mengxiao Zhang, Yishay Mansour arxiv

We study stochastic linear bandits with delayed feedback under several delay models and establish near-optimal regret guarantees. Our results identify when delayed linear bandits exhibit the same qualitative behavior as …

Multi-Armed Bandits

The Real Price of Bandit Information in Multiclass Classification

2024-05-16 · Liad Erez, Alon Cohen, Tomer Koren, Yishay Mansour 외

We revisit the classical problem of multiclass classification with bandit feedback (Kakade, Shalev-Shwartz and Tewari, 2008), where each input classifies to one of $K$ possible labels and feedback is restricted to whethe…