paper-with-me

홈 › Papers

A Local Regret in Nonconvex Online Learning

2018-11-13 · Sergul Aydore, Lee Dicker, Dean Foster

We consider an online learning process to forecast a sequence of outcomes for nonconvex models. A typical measure to evaluate online learning algorithms is regret but such standard definition of regret is intractable for nonconvex models even in offline settings. Hence, gradient based definition of regrets are common for both offline and online nonconvex problems. Recently, a notion of local gradient based regret was introduced. Inspired by the concept of calibration and a local gradient based regret, we introduce another definition of regret and we discuss why our definition is more interpretable for forecasting problems. We also provide bound analysis for our regret under certain assumptions.

📄 PDF Abstract BibTeX arXiv:1811.05095

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributed Online Bandit Nonconvex Optimization with One-Point Residual Feedback via Dynamic Regret

2024-09-24 · Youqing Hua, Shuai Liu, Yiguang Hong, Karl Henrik Johansson 외

This paper considers the distributed online bandit optimization problem with nonconvex loss functions over a time-varying digraph. This problem can be viewed as a repeated game between a group of online players and an ad…

Multi-Point Bandit Algorithms for Nonstationary Online Nonconvex Optimization

2019-07-31 · Abhishek Roy, Krishnakumar Balasubramanian, Saeed Ghadimi, Prasant Mohapatra

Bandit algorithms have been predominantly analyzed in the convex setting with function-value based stationary regret as the performance measure. In this paper, motivated by online reinforcement learning problems, we prop…

Reinforcement Learning

Privacy-Preserving Distributed Online Mirror Descent for Nonconvex Optimization

2025-01-08 · Yingjie Zhou, Tao Li

We investigate the distributed online nonconvex optimization problem with differential privacy over time-varying networks. Each node minimizes the sum of several nonconvex functions while preserving the node's differenti…

Privacy Preserving

Online Nonconvex Bilevel Optimization with Bregman Divergences

2024-09-16 · Jason Bohne, David Rosenberg, Gary Kazantsev, Pawel Polak

Bilevel optimization methods are increasingly relevant within machine learning, especially for tasks such as hyperparameter optimization and meta-learning. Compared to the offline setting, online bilevel optimization (OB…

Bilevel OptimizationHyperparameter OptimizationMeta-Learning

Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback

2026-05-25 · Anas Barakat, Andreas Kontogiannis, Vasilis Pollatos, Ioannis Panageas 외 arxiv

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assump…