paper-with-me

홈 › Papers

Online Optimization in Dynamic Environments: Improved Regret Rates for Strongly Convex Problems

2016-03-16 · Aryan Mokhtari, Shahin Shahrampour, Ali Jadbabaie, Alejandro Ribeiro

In this paper, we address tracking of a time-varying parameter with unknown dynamics. We formalize the problem as an instance of online optimization in a dynamic setting. Using online gradient descent, we propose a method that sequentially predicts the value of the parameter and in turn suffers a loss. The objective is to minimize the accumulation of losses over the time horizon, a notion that is termed dynamic regret. While existing methods focus on convex loss functions, we consider strongly convex functions so as to provide better guarantees of performance. We derive a regret bound that captures the path-length of the time-varying parameter, defined in terms of the distance between its consecutive values. In other words, the bound represents the natural connection of tracking quality to the rate of change of the parameter. We provide numerical experiments to complement our theoretical findings.

📄 PDF Abstract BibTeX arXiv:1603.04954

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Adaptive Online Learning in Dynamic Environments

2018-10-25 · NeurIPS 2018 12 · Lijun Zhang, Shiyin Lu, Zhi-Hua Zhou

In this paper, we study online convex optimization in dynamic environments, and aim to bound the dynamic regret with respect to any sequence of comparators. Existing work have shown that online gradient descent enjoys an…

Universal Online Optimization in Dynamic Environments via Uniclass Prediction

2023-02-13 · Arnold Salas

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms ha…

Non-stationary Online Convex Optimization with Arbitrary Delays

2023-05-20 · Yuanyu Wan, Chang Yao, Mingli Song, Lijun Zhang

Online convex optimization (OCO) with arbitrary delays, in which gradients or other information of functions could be arbitrarily delayed, has received increasing attention recently. Different from previous studies that …

Improved Dynamic Regret for Online Frank-Wolfe

2023-02-11 · Yuanyu Wan, Lijun Zhang, Mingli Song

To deal with non-stationary online problems with complex constraints, we investigate the dynamic regret of online Frank-Wolfe (OFW), which is an efficient projection-free algorithm for online convex optimization. It is w…

Online convex optimization for constrained control of nonlinear systems

2024-12-01 · Marko Nonhoff, Johannes Köhler, Matthias A. Müller

This paper investigates the problem of controlling nonlinear dynamical systems subject to state and input constraints while minimizing time-varying and a priori unknown cost functions. We propose a modular approach that …