paper-with-me

홈 › Papers

CLASP: An online learning algorithm for Convex Losses And Squared Penalties

2026-01-22 · Ricardo N. Ferreira, João Xavier, Cláudia Soares arxiv

We study Constrained Online Convex Optimization (COCO), where a learner chooses actions iteratively, observes both unanticipated convex loss and convex constraint, and accumulates loss while incurring penalties for constraint violations. We introduce CLASP (Convex Losses And Squared Penalties), an algorithm that minimizes cumulative loss together with squared constraint violations. Our analysis departs from prior work by fully leveraging the firm non-expansiveness of convex projectors, a proof strategy not previously applied in this setting. For convex losses, CLASP achieves regret $O\left(T^{\max\{β,1-β\}}\right)$ and cumulative squared penalty $O\left(T^{1-β}\right)$ for any $β\in (0,1)$. Most importantly, for strongly convex problems, CLASP provides the first logarithmic guarantees on both regret and cumulative squared penalty. In the strongly convex case, the regret is upper bounded by $O( \log T )$ and the cumulative squared penalty is also upper bounded by $O( \log T )$.

📄 PDF Abstract BibTeX arXiv:2601.16072

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Small Gradient Norm Regret for Online Convex Optimization

2026-01-20 · Wenzhi Gao, Chang He, Madeleine Udell arxiv

This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the $G^\star$ regret, depends on the cumulative squared gradient norm evaluated at…

Stochastic Optimization

Second-Order Kernel Online Convex Optimization with Adaptive Sketching

2017-06-15 · ICML 2017 8 · Daniele Calandriello, Alessandro Lazaric, Michal Valko

Kernel online convex optimization (KOCO) is a framework combining the expressiveness of non-parametric kernel models with the regret guarantees of online learning. First-order KOCO methods such as functional gradient des…

Second-order methods

Dynamic Regret for Strongly Adaptive Methods and Optimality of Online KRR

2021-11-22 · Dheeraj Baby, Hilaf Hasson, Yuyang Wang

We consider the framework of non-stationary Online Convex Optimization where a learner seeks to control its dynamic regret against an arbitrary sequence of comparators. When the loss functions are strongly convex or exp-…

Open-Ended Question Answeringregression

Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback

2026-05-25 · Anas Barakat, Andreas Kontogiannis, Vasilis Pollatos, Ioannis Panageas 외 arxiv

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assump…

A Modern Introduction to Online Learning

2019-12-31 · Francesco Orabona

In this monograph, I introduce the basic concepts of Online Learning through a modern view of Online Convex Optimization. Here, online learning refers to the framework of regret minimization under worst-case assumptions.…

AllMulti-Armed Bandits