paper-with-me

홈 › Papers

Robust Sublinear Convergence Rates for Iterative Bregman Projections

2026-02-01 · Gabriel Peyré arxiv

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with Sinkhorn-type algorithms for optimal transport, matrix scaling, and barycenters as canonical examples. This paper gives a general blueprint for proving $O(1/k)$ dual convergence rate with a constant that scales only linearly in $1/γ$, where $γ$ is the entropic regularization parameter. We call such rates "robust", because this mild dependence on $γ$ underpins favorable complexity bounds for approximating the unregularized problem via alternating KL projections. The blueprint reduces the proof to a uniform primal bound and a dual bound for a quotient norm induced by the constraint split. To make these inputs usable, we propose two helper results, which rely on the non-expansiveness of the dual iterations in this quotient dual norm. Instantiating this blueprint for graph-structured transport yields a new flow-Sinkhorn algorithm for the Wasserstein-1 distance on graphs. It achieves $\varepsilon$-additive accuracy on the transshipment cost in $O(p\,\mathrm{diameter}^3/\varepsilon^{4})$ arithmetic operations (up to logarithmic factors), where $p$ is the number of edges. We also provide a machine-checked Lean formalization of the core blueprint and its graph-$\mathrm{W}_1$ instantiation.

📄 PDF Abstract BibTeX arXiv:2602.01372

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Reusing Combinatorial Structure: Faster Iterative Projections over Submodular Base Polytopes

2021-06-22 · NeurIPS 2021 12 · Jai Moondra, Hassan Mortagy, Swati Gupta

Optimization algorithms such as projected Newton's method, FISTA, mirror descent, and its variants enjoy near-optimal regret bounds and convergence rates, but suffer from a computational bottleneck of computing ``project…

The Linearized Bregman Method via Split Feasibility Problems: Analysis and Generalizations

2013-09-09 · Dirk A. Lorenz, Frank Schöpfer, Stephan Wenger

The linearized Bregman method is a method to calculate sparse solutions to systems of linear equations. We formulate this problem as a split feasibility problem, propose an algorithmic framework based on Bregman projecti…

Convergence of Batch Greenkhorn for Regularized Multimarginal Optimal Transport

2021-12-01 · Vladimir Kostic, Saverio Salzo, Massimilano Pontil

In this work we propose a batch version of the Greenkhorn algorithm for multimarginal regularized optimal transport problems. Our framework is general enough to cover, as particular cases, some existing algorithms like S…

The rate of convergence of Bregman proximal methods: Local geometry vs. regularity vs. sharpness

2022-11-15 · Waïss Azizian, Franck Iutzeler, Jérôme Malick, Panayotis Mertikopoulos

We examine the last-iterate convergence rate of Bregman proximal methods - from mirror descent to mirror-prox and its optimistic variants - as a function of the local geometry induced by the prox-mapping defining the met…

A Universal Banach--Bregman Framework for Stochastic Iterations: Unifying Stochastic Mirror Descent, Learning and LLM Training

2025-09-17 · Johnny R. Zhang, Xiaomei Mi, Gaoyuan Du, Qianyi Sun 외 arxiv

Stochastic optimization powers the scalability of modern artificial intelligence, spanning machine learning, deep learning, reinforcement learning, and large language model training. Yet, existing theory remains largely …

Stochastic OptimizationReinforcement LearningSparse Learning