paper-with-me

Papers

Revisiting Projection-Free Optimization for Strongly Convex Constraint Sets

2018-11-14 · Jarrid Rector-Brooks, Jun-Kun Wang, Barzan Mozafari

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard variant. With line search, we show that FW can converge to the global optimum, even for smooth functions that are not convex, but are quasi-convex and locally-Lipschitz. We also show that, for the general case of (smooth) non-convex functions, FW with line search converges with high probability to a stationary point at a rate of $O\left(\frac{1}{t}\right)$, as long as the constraint set is strongly convex -- one of the fastest convergence rates in non-convex optimization.

📄 PDF Abstract BibTeX arXiv:1811.05831

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Revisiting Projection-free Online Learning: the Strongly Convex Case

2020-10-15 · Dan Garber, Ben Kretzu

Projection-free optimization algorithms, which are mostly based on the classical Frank-Wolfe method, have gained significant interest in the machine learning community in recent years due to their ability to handle conve…

Revisiting Projection-Free Online Learning with Time-Varying Constraints

2025-01-27 · Yibo Wang, Yuanyu Wan, Lijun Zhang

We investigate constrained online convex optimization, in which decisions must belong to a fixed and typically complicated domain, and are required to approximately satisfy additional time-varying constraints over the lo…

Gauges and Accelerated Optimization over Smooth and/or Strongly Convex Sets

2023-03-09 · Ning Liu, Benjamin Grimmer

We consider feasibility and constrained optimization problems defined over smooth and/or strongly convex sets. These notions mirror their popular function counterparts but are much less explored in the first-order optimi…

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization

2024-06-06 · Wei Jiang, Sifan Yang, Wenhao Yang, Yibo Wang 외

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is…

Projection-free Online Learning over Strongly Convex Sets

2020-10-16 · Yuanyu Wan, Lijun Zhang

To efficiently solve online problems with complicated constraints, projection-free algorithms including online frank-wolfe (OFW) and its variants have received significant interest recently. However, in the general case,…