paper-with-me

홈 › Papers

An Efficient Interior-Point Method for Online Convex Optimization

2023-07-21 · Elad Hazan, Nimrod Megiddo

A new algorithm for regret minimization in online convex optimization is described. The regret of the algorithm after $T$ time periods is $O(\sqrt{T \log T})$ - which is the minimum possible up to a logarithmic term. In addition, the new algorithm is adaptive, in the sense that the regret bounds hold not only for the time periods $1,\ldots,T$ but also for every sub-interval $s,s+1,\ldots,t$. The running time of the algorithm matches that of newly introduced interior point algorithms for regret minimization: in $n$-dimensional space, during each iteration the new algorithm essentially solves a system of linear equations of order $n$, rather than solving some constrained convex optimization problem in $n$ dimensions and possibly many constraints.

📄 PDF Abstract BibTeX arXiv:2307.11668

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Single-Loop Deterministic and Stochastic Interior-Point Algorithms for Nonlinearly Constrained Optimization

2024-08-29 · Frank E. Curtis, Xin Jiang, Qi Wang

An interior-point algorithm framework is proposed, analyzed, and tested for solving nonlinearly constrained continuous optimization problems. The main setting of interest is when the objective and constraint functions ma…

Faster Convex Optimization: Simulated Annealing with an Efficient Universal Barrier

2015-07-09 · Jacob Abernethy, Elad Hazan

This paper explores a surprising equivalence between two seemingly-distinct convex optimization methods. We show that simulated annealing, a well-studied random walk algorithms, is directly equivalent, in a certain sense…

On the Online Frank-Wolfe Algorithms for Convex and Non-convex Optimizations

2015-10-05 · Jean Lafond, Hoi-To Wai, Eric Moulines

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-ad…

A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization

2021-06-15 · Risheng Liu, Xuan Liu, Xiaoming Yuan, Shangzhi Zeng 외

Bi-level optimization model is able to capture a wide range of complex learning tasks with practical interest. Due to the witnessed efficiency in solving bi-level programs, gradient-based methods have gained popularity i…

A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problems

2023-04-28 · Frank E. Curtis, Vyacheslav Kungurtsev, Daniel P. Robinson, Qi Wang

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through e…