paper-with-me

홈 › Papers

Efficient and Optimal Fixed-Time Regret with Two Experts

2022-03-15 · Laura Greenstreet, Nicholas J. A. Harvey, Victor Sanches Portella

Prediction with expert advice is a foundational problem in online learning. In instances with $T$ rounds and $n$ experts, the classical Multiplicative Weights Update method suffers at most $\sqrt{(T/2)\ln n}$ regret when $T$ is known beforehand. Moreover, this is asymptotically optimal when both $T$ and $n$ grow to infinity. However, when the number of experts $n$ is small/fixed, algorithms with better regret guarantees exist. Cover showed in 1967 a dynamic programming algorithm for the two-experts problem restricted to $\{0,1\}$ costs that suffers at most $\sqrt{T/2\pi} + O(1)$ regret with $O(T^2)$ pre-processing time. In this work, we propose an optimal algorithm for prediction with two experts' advice that works even for costs in $[0,1]$ and with $O(1)$ processing time per turn. Our algorithm builds up on recent work on the experts problem based on techniques and tools from stochastic calculus.

📄 PDF Abstract BibTeX arXiv:2203.07577

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

Optimal anytime regret with two experts

2020-02-20 · Nicholas J. A. Harvey, Christopher Liaw, Edwin Perkins, Sikander Randhawa

We consider the classical problem of prediction with expert advice. In the fixed-time setting, where the time horizon is known in advance, algorithms that achieve the optimal regret are known when there are two, three, o…

Vocal Bursts Valence Prediction

Continuous Prediction with Experts' Advice

2022-06-01 · Victor Sanches Portella, Christopher Liaw, Nicholas J. A. Harvey

Prediction with experts' advice is one of the most fundamental problems in online learning and captures many of its technical challenges. A recent line of work has looked at online learning through the lens of differenti…

Prediction

Information-Theoretic Regret Bounds for Bandits with Fixed Expert Advice

2023-03-14 · Khaled Eldowa, Nicolò Cesa-Bianchi, Alberto Maria Metelli, Marcello Restelli

We investigate the problem of bandits with expert advice when the experts are fixed and known distributions over the actions. Improving on previous analyses, we show that the regret in this setting is controlled by infor…

Efficient tracking of a growing number of experts

2017-08-31 · Jaouad Mourtada, Odalric-Ambrym Maillard

We consider a variation on the problem of prediction with expert advice, where new forecasters that were unknown until then may appear at each round. As often in prediction with expert advice, designing an algorithm that…

Incentive-compatible Bandits: Importance Weighting No More

2024-05-10 · Julian Zimmert, Teodor V. Marinov

We study the problem of incentive-compatible online learning with bandit feedback. In this class of problems, the experts are self-interested agents who might misrepresent their preferences with the goal of being selecte…