paper-with-me

Papers

Fast Log-Domain Sinkhorn Optimal Transport with Warp-Level GPU Reductions

2026-04-04 · Hao Xiao arxiv

Entropic regularized optimal transport (OT) via the Sinkhorn algorithm has become a fundamental tool in machine learning, yet existing implementations either suffer from numerical instability for small regularization parameters or incur significant overhead from deep learning frameworks. We present FastSinkhorn, a lightweight, native CUDA implementation of the log-domain Sinkhorn algorithm that combines warp-level shuffle reductions with shared-memory tiling to achieve high GPU utilization without sacrificing numerical stability. Our solver operates entirely in the log-domain, enabling robust computation for regularization parameters as small as epsilon = 10^{-4} where standard-domain methods fail. On dense OT problems with n = m = 8192, our implementation achieves 12x speedup over the widely-used POT library and 5.9x speedup over GPU-accelerated PyTorch baselines, while consuming only 256 MB of GPU memory. We validate our solver on image color transfer, 3D point cloud matching, and convergence analysis, demonstrating that native CUDA kernels with careful numerical treatment provide a practical and efficient foundation for large-scale optimal transport computation.

📄 PDF Abstract BibTeX arXiv:2605.00837

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mirror Sinkhorn: Fast Online Optimization on Transport Polytopes

2022-11-18 · Marin Ballu, Quentin Berthet

Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimi…

Point Cloud Registration

Sinkhorn Divergences for Unbalanced Optimal Transport

2019-10-28 · Thibault Séjourné, Jean Feydy, François-Xavier Vialard, Alain Trouvé 외

Optimal transport induces the Earth Mover's (Wasserstein) distance between probability distributions, a geometric divergence that is relevant to a wide range of problems. Over the last decade, two relaxations of optimal …

Warpspeed Computation of Optimal Transport, Graph Distances, and Embedding Alignment

2021-01-01 · Johannes Klicpera, Marten Lienen, Stephan Günnemann

Optimal transport (OT) is a cornerstone of many machine learning tasks. The current best practice for computing OT is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time and requires…

Distance regression

A Sinkhorn-type Algorithm for Constrained Optimal Transport

2024-03-08 · Xun Tang, Holakou Rahmanian, Michael Shavlovsky, Kiran Koshy Thekumparampil 외

Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In…

Scheduling

A Survey on Algorithmic Developments in Optimal Transport Problem with Applications

2025-01-08 · Sina Moradi

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This …

Dynamic Time Warping