paper-with-me

홈 › Papers

Tight Bounds on Minimax Regret under Logarithmic Loss via Self-Concordance

2020-07-02 · Blair Bilodeau, Dylan J. Foster, Daniel M. Roy

We consider the classical problem of sequential probability assignment under logarithmic loss while competing against an arbitrary, potentially nonparametric class of experts. We obtain tight bounds on the minimax regret via a new approach that exploits the self-concordance property of the logarithmic loss. We show that for any expert class with (sequential) metric entropy $\mathcal{O}(\gamma^{-p})$ at scale $\gamma$, the minimax regret is $\mathcal{O}(n^{p/(p+1)})$, and that this rate cannot be improved without additional assumptions on the expert class under consideration. As an application of our techniques, we resolve the minimax regret for nonparametric Lipschitz classes of experts.

📄 PDF Abstract BibTeX arXiv:2007.01160

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Expected Worst Case Regret via Stochastic Sequential Covering

2022-09-09 · Changlong Wu, Mohsen Heidari, Ananth Grama, Wojciech Szpankowski

We study the problem of sequential prediction and online minimax regret with stochastically generated features under a general loss function. We introduce a notion of expected worst case minimax regret that generalizes a…

Minimax Optimal Quantile and Semi-Adversarial Regret via Root-Logarithmic Regularizers

2021-10-27 · NeurIPS 2021 12 · Jeffrey Negrea, Blair Bilodeau, Nicolò Campolongo, Francesco Orabona 외

Quantile (and, more generally, KL) regret bounds, such as those achieved by NormalHedge (Chaudhuri, Freund, and Hsu 2009) and its variants, relax the goal of competing against the best individual expert to only competing…

Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphs

2022-06-02 · Shinji Ito, Taira Tsuchiya, Junya Honda

This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly…

Open-Ended Question Answering

Adaptive Minimax Regret against Smooth Logarithmic Losses over High-Dimensional $\ell_1$-Balls via Envelope Complexity

2018-10-09 · Kohei Miyaguchi, Kenji Yamanishi

We develop a new theoretical framework, the \emph{envelope complexity}, to analyze the minimax regret with logarithmic loss functions and derive a Bayesian predictor that adaptively achieves the minimax regret over high-…

Precise Regret Bounds for Log-loss via a Truncated Bayesian Algorithm

2022-05-07 · Changlong Wu, Mohsen Heidari, Ananth Grama, Wojciech Szpankowski

We study the sequential general online regression, known also as the sequential probability assignments, under logarithmic loss when compared against a broad class of experts. We focus on obtaining tight, often matching,…