paper-with-me

Papers

On the Computational Efficiency of Adaptive and Dynamic Regret Minimization

2022-07-01 · Zhou Lu, Elad Hazan

In online convex optimization, the player aims to minimize regret, or the difference between her loss and that of the best fixed decision in hindsight over the entire repeated game. Algorithms that minimize (standard) regret may converge to a fixed decision, which is undesirable in changing or dynamic environments. This motivates the stronger metrics of performance, notably adaptive and dynamic regret. Adaptive regret is the maximum regret over any continuous sub-interval in time. Dynamic regret is the difference between the total cost and that of the best sequence of decisions in hindsight. State-of-the-art performance in both adaptive and dynamic regret minimization suffers a computational penalty - typically on the order of a multiplicative factor that grows logarithmically in the number of game iterations. In this paper we show how to reduce this computational penalty to be doubly logarithmic in the number of game iterations, and retain near optimal adaptive and dynamic regret bounds.

📄 PDF Abstract BibTeX arXiv:2207.00646

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Minimizing Dynamic Regret and Adaptive Regret Simultaneously

2020-02-06 · Lijun Zhang, Shiyin Lu, Tianbao Yang

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environmen…

Efficient Last-Iterate Convergence in Regret Minimization via Adaptive Reward Transformation

2025-09-17 · Hang Ren, Yulin Wu, Shuhan Qi, Jiajia Zhang 외 arxiv

Regret minimization is a powerful method for finding Nash equilibria in Normal-Form Games (NFGs) and Extensive-Form Games (EFGs), but it typically guarantees convergence only for the average strategy. However, computing …

Efficient Non-stationary Online Learning by Wavelets with Applications to Online Distribution Shift Adaptation

2024-07-21 · Proceedings of the 41st International Conference on Machine Learning (ICML) 2024 7 · Yu-Yang Qian, Peng Zhao, Yu-Jie Zhang, Masashi Sugiyama 외

Dynamic regret minimization offers a principled way for non-stationary online learning, where the algorithm's performance is evaluated against changing comparators. Prevailing methods often employ a two-layer online ense…

Regret Minimization and Convergence to Equilibria in General-sum Markov Games

2022-07-28 · Liad Erez, Tal Lancewicki, Uri Sherman, Tomer Koren 외

An abundance of recent impossibility results establish that regret minimization in Markov games with adversarial opponents is both statistically and computationally intractable. Nevertheless, none of these results preclu…

Tracking the Best Expert Privately

2025-03-12 · Aadirupa Saha, Vinod Raman, Hilal Asi

We design differentially private algorithms for the problem of prediction with expert advice under dynamic regret, also known as tracking the best expert. Our work addresses three natural types of adversaries, stochastic…