paper-with-me

Papers

Stochastic Online Learning with Feedback Graphs: Finite-Time and Asymptotic Optimality

2022-06-20 · Teodor V. Marinov, Mehryar Mohri, Julian Zimmert

We revisit the problem of stochastic online learning with feedback graphs, with the goal of devising algorithms that are optimal, up to constants, both asymptotically and in finite time. We show that, surprisingly, the notion of optimal finite-time regret is not a uniquely defined property in this context and that, in general, it is decoupled from the asymptotic rate. We discuss alternative choices and propose a notion of finite-time optimality that we argue is \emph{meaningful}. For that notion, we give an algorithm that admits quasi-optimal regret both in finite-time and asymptotically.

📄 PDF Abstract BibTeX arXiv:2206.10022

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Online Learning with Dependent Stochastic Feedback Graphs

2020-01-01 · ICML 2020 1 · Corinna Cortes, Giulia Desalvo, Claudio Gentile, Mehryar Mohri 외

A general framework for online learning with partial information is one where feedback graphs specify which losses can be observed by the learner. We study a challenging scenario where feedback graphs vary stochastically…

A Near-Optimal Best-of-Both-Worlds Algorithm for Online Learning with Feedback Graphs

2022-06-01 · Chloé Rouyer, Dirk van der Hoeven, Nicolò Cesa-Bianchi, Yevgeny Seldin

We consider online learning with feedback graphs, a sequential decision-making framework where the learner's feedback is determined by a directed graph over the action set. We present a computationally efficient algorith…

Decision MakingSequential Decision Making

Online Learning with Feedback Graphs Without the Graphs

2016-05-23 · Alon Cohen, Tamir Hazan, Tomer Koren

We study an online learning framework introduced by Mannor and Shamir (2011) in which the feedback is specified by a graph, in a setting where the graph may vary from round to round and is \emph{never fully revealed} to …

Small-loss bounds for online learning with partial information

2017-11-09 · Thodoris Lykouris, Karthik Sridharan, Eva Tardos

We consider the problem of adversarial (non-stochastic) online learning with partial information feedback, where at each round, a decision maker selects an action from a finite set of alternatives. We develop a black-box…

Multi-Armed Bandits

Stochastic Online Learning with Probabilistic Graph Feedback

2019-03-04 · Shuai Li, Wei Chen, Zheng Wen, Kwong-Sak Leung

We consider a problem of stochastic online learning with general probabilistic graph feedback, where each directed edge in the feedback graph has probability $p_{ij}$. Two cases are covered. (a) The one-step case, where …