paper-with-me

홈 › Papers

Continuous-Time Dynamics of the Difference-of-Convex Algorithm

2026-04-08 · Yi-Shuai Niu arxiv

We study the continuous-time structure of the difference-of-convex algorithm (DCA) for smooth DC decompositions with a strongly convex component. In dual coordinates, classical DCA is exactly the full-step explicit Euler discretization of a nonlinear autonomous system. This viewpoint motivates a damped DCA scheme, which is also a Bregman-regularized DCA variant, and whose vanishing-step limit yields a Hessian-Riemannian gradient flow generated by the convex part of the decomposition. For the damped scheme we prove monotone descent, asymptotic criticality, Kurdyka-Lojasiewicz convergence under boundedness, and a global linear rate under a metric DC-PL inequality. For the limiting flow we establish an exact energy identity, asymptotic criticality of bounded trajectories, explicit global rates under metric relative error bounds, finite-length and single-point convergence under a Kurdyka-Lojasiewicz hypothesis, and local exponential convergence near nondegenerate local minima. The analysis also reveals a global-local tradeoff: the half-relaxed scheme gives the best provable global guarantee in our framework, while the full-step scheme is locally fastest near a nondegenerate minimum. Finally, we show that different DC decompositions of the same objective induce different continuous dynamics through the metric generated by the convex component, providing a geometric criterion for decomposition quality and linking DCA with Bregman geometry.

📄 PDF Abstract BibTeX arXiv:2604.06926

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Convexity of Optimization Curves: Local Sharp Thresholds, Robustness Impossibility, and New Counterexamples

2025-09-10 · Le Duc Hieu arxiv

We study when the \emph{optimization curve} of first-order methods -- the sequence \${f(x\_n)}*{n\ge0}\$ produced by constant-stepsize iterations -- is convex, equivalently when the forward differences \$f(x\_n)-f(x*{n+1…

Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems

2021-12-17 · Thinh T. Doan

There are much recent interests in solving noncovnex min-max optimization problems due to its broad applications in many areas including machine learning, networked resource allocations, and distributed optimization. Per…

Distributed Optimization

Accelerated Convex Optimization via Hamiltonian Dynamics with Deterministic Integration Time

2026-06-15 · Xiuyuan Wang, Vishwak Srinivasan, Qiang Fu, Siddharth Mitra 외 arxiv

We develop Hamiltonian dynamics-based algorithms for smooth convex optimization that achieve accelerated rates of convergence. By exploiting contraction of averaged Hamiltonian flow trajectories rather than requiring con…

The Wasserstein Proximal Gradient Algorithm

2020-02-07 · NeurIPS 2020 12 · Adil Salim, Anna Korba, Giulia Luise

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typ…

Solving Dense Image Matching in Real-Time using Discrete-Continuous Optimization

2016-01-23 · Alexander Shekhovtsov, Christian Reinbacher, Gottfried Graber, Thomas Pock

Dense image matching is a fundamental low-level problem in Computer Vision, which has received tremendous attention from both discrete and continuous optimization communities. The goal of this paper is to combine the adv…

Optical Flow EstimationStereo MatchingStereo Matching Hand