paper-with-me

홈 › Papers

SinkSLOT: Sinkhorn via Sparse Lifted Optimal Transport

2026-08-28 · Ian Hsieh, Soumya Snigdha Kundu, Tom Vercauteren, Reuben Dorent arxiv

Entropic optimal transport (EOT) has been shown to offer a computationally tractable approximation to exact optimal transport. However, the standard Sinkhorn-Knopp algorithm has two main limitations. First, given discrete measures with $N$ points, each iteration requires $O(N^2)$ operations, which restricts its use on large-scale datasets (e.g. $N\geq10^4$). Second, it uses the independent coupling as a reference measure for regularisation. This assigns mass to high-cost transport edges at moderate regularisation strengths. We propose SinkSLOT, which addresses both limitations by putting forth the expected sliced lifted transport plan as a natural way to sparsify the Gibbs kernel with a non-independent prior coupling. We prove that: 1) SinkSLOT converges; 2) with $L$ slices, each resulting sparse Sinkhorn iteration costs $O(LN)$; and 3) the resulting objective is a divergence requiring no debiasing. Experiments on synthetic benchmarks show that SinkSLOT delivers substantial speedups over state-of-the-art dense and sparse EOT methods. We also demonstrate the applicability of the proposed divergence in a gradient flow experiment. The code is publicly available at https://github.com/cai4cai/SinkSLOT.

📄 PDF Abstract BibTeX arXiv:2608.28262

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Accelerating Sinkhorn Algorithm with Sparse Newton Iterations

2024-01-20 · Xun Tang, Michael Shavlovsky, Holakou Rahmanian, Elisa Tardini 외

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilize…

Geodesic Sinkhorn for Fast and Accurate Optimal Transport on Manifolds

2022-11-02 · Guillaume Huguet, Alexander Tong, María Ramos Zapatero, Christopher J. Tape 외

Efficient computation of optimal transport distance between distributions is of growing importance in data science. Sinkhorn-based methods are currently the state-of-the-art for such computations, but require $O(n^2)$ co…

Dimensionality ReductionTime SeriesTime Series AnalysisVocal Bursts Intensity Prediction

Warpspeed Computation of Optimal Transport, Graph Distances, and Embedding Alignment

2021-01-01 · Johannes Klicpera, Marten Lienen, Stephan Günnemann

Optimal transport (OT) is a cornerstone of many machine learning tasks. The current best practice for computing OT is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time and requires…

Distance regression

Selective Sinkhorn Routing for Improved Sparse Mixture of Experts

2025-11-12 · Duc Anh Nguyen, Huu Binh Ta, Nhuan Le Duc, Tan Minh Nguyen 외 arxiv

Sparse Mixture-of-Experts (SMoE) models are scalable and computationally efficient, enabling large increases in model capacity with limited inference overhead. Existing SMoE methods often depend on auxiliary objectives, …

Image Classification

PINS: Proximal Iterations with Sparse Newton and Sinkhorn for Optimal Transport

2025-02-06 · Di wu, Ling Liang, Haizhao Yang

Optimal transport (OT) is a critical problem in optimization and machine learning, where accuracy and efficiency are paramount. Although entropic regularization and the Sinkhorn algorithm improve scalability, they freque…