paper-with-me

Papers

Nonmonotone subgradient methods based on a local descent lemma

2025-10-22 · Francisco J. Aragón-Artacho, Rubén Campoy, Pedro Pérez-Aros, David Torregrosa-Belén arxiv

In this paper we present a nonmonotone line search subgradient algorithm tailored to upper-$\mathcal{C}^2$ functions. This is a family of nonsmooth and nonconvex functions that satisfies a nonsmooth and local version of the descent lemma, making them suitable for line searches. We prove subsequential convergence of the proposed algorithm to a stationary point of the optimization problem. Our approach allows us to cover the setting of various subgradient algorithms, including Newton and quasi-Newton methods. In addition, we propose a specification of the general scheme, named Self-adaptive Nonmonotone Subgradient Method (SNSM), which automatically updates the parameters of the line search. Particular attention is paid to the minimum sum-of-squares clustering problem, for which we provide a concrete implementation of SNSM. We conclude with some numerical experiments where we exhibit the advantages of SNSM in comparison with some known algorithms.

📄 PDF Abstract BibTeX arXiv:2510.19341

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Convergence Rates for Deterministic and Stochastic Subgradient Methods Without Lipschitz Continuity

2017-12-12 · Benjamin Grimmer

We extend the classic convergence rate theory for subgradient methods to apply to non-Lipschitz functions. For the deterministic projected subgradient method, we present a global $O(1/\sqrt{T})$ convergence rate for any …

Inexact subgradient methods for semialgebraic functions

2024-04-30 · Jérôme Bolte, Tam Le, Éric Moulines, Edouard Pauwels

Motivated by the extensive application of approximate gradients in machine learning and optimization, we investigate inexact subgradient methods subject to persistent additive errors. Within a nonconvex semialgebraic fra…

Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models

2023-06-22 · NeurIPS 2023 11

Recent works have shown that line search methods can speed up Stochastic Gradient Descent (SGD) and Adam in modern over-parameterized settings. However, existing line searches may take steps that are smaller than necessa…

Optimal Sample Complexity of Subgradient Descent for Amplitude Flow via Non-Lipschitz Matrix Concentration

2020-10-31 · Paul Hand, Oscar Leong, Vladislav Voroninski

We consider the problem of recovering a real-valued $n$-dimensional signal from $m$ phaseless, linear measurements and analyze the amplitude-based non-smooth least squares objective. We establish local convergence of sub…

A Randomized Nonmonotone Block Proximal Gradient Method for a Class of Structured Nonlinear Programming

2013-06-25 · Zhaosong Lu, Lin Xiao

We propose a randomized nonmonotone block proximal gradient (RNBPG) method for minimizing the sum of a smooth (possibly nonconvex) function and a block-separable (possibly nonconvex nonsmooth) function. At each iteration…