paper-with-me

홈 › Papers

On the Efficiency of Sinkhorn-Knopp for Entropically Regularized Optimal Transport

2026-04-04 · Kun He arxiv

The Sinkhorn--Knopp (SK) algorithm is a cornerstone method for matrix scaling and entropically regularized optimal transport (EOT). Despite its empirical efficiency, existing theoretical guarantees to achieve a target marginal accuracy $\varepsilon$ deteriorate severely in the presence of outliers, bottlenecked either by the global maximum regularized cost $η\|C\|_\infty$ (where $η$ is the regularization parameter and $C$ the cost matrix) or the matrix's minimum-to-maximum entry ratio $ν$. This creates a fundamental disconnect between theory and practice. In this paper, we resolve this discrepancy. For EOT, we introduce the novel concept of well-boundedness, a local bulk mass property that rigorously isolates the well-behaved portion of the data from extreme outliers. We prove that governed by this fundamental notion, SK recovers the target transport plan for a problem of dimension $n$ in $O(\log n - \log \varepsilon)$ iterations, completely independent of the regularized cost $η\|C\|_\infty$. Furthermore, we show that a virtually cost-free pre-scaling step eliminates the dimensional dependence entirely, accelerating convergence to a strictly dimension-free $O(\log(1/\varepsilon))$ iterations. Beyond EOT, we establish a sharp phase transition for general $(\boldsymbol{u},\boldsymbol{v})$-scaling governed by a critical matrix density threshold. We prove that when a matrix's density exceeds this threshold, the iteration complexity is strictly independent of $ν$. Conversely, when the density falls below this threshold, the dependence on $ν$ becomes unavoidable; in this sub-critical regime, we construct instances where SK requires $Ω(n/\varepsilon)$ iterations.

📄 PDF Abstract BibTeX arXiv:2604.03787

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The derivatives of Sinkhorn-Knopp converge

2022-07-26 · Edouard Pauwels, Samuel Vaiter

We show that the derivatives of the Sinkhorn-Knopp algorithm, or iterative proportional fitting procedure, converge towards the derivatives of the entropic regularization of the optimal transport problem with a locally u…

EMS Coreset: An Efficient Expectation-Maximization Algorithm for Sinkhorn Coreset

2026-08-17 · Haoyun Yin, Chuanhui Liu, Xiao Wang arxiv

Coresets distill large datasets into small, representative subsets for efficient downstream learning. Yet Optimal Transport (OT)-based selection typically requires intensive computation of transport plans, limiting scala…

Coreset selection for the Sinkhorn divergence and generic smooth divergences

2025-04-28 · Alex Kokot, Alex Luedtke

We introduce CO2, an efficient algorithm to produce convexly-weighted coresets with respect to generic smooth divergences. By employing a functional Taylor expansion, we show a local equivalence between sufficiently regu…

A Sinkhorn-Newton method for entropic optimal transport

2017-10-18 · Christoph Brauer, Christian Clason, Dirk Lorenz, Benedikt Wirth

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically th…

Phase transition of the Sinkhorn-Knopp algorithm

2025-07-13 · Kun He arxiv

The matrix scaling problem, particularly the Sinkhorn-Knopp algorithm, has been studied for over 60 years. In practice, the algorithm often yields high-quality approximations within just a few iterations. Theoretically, …