paper-with-me

Papers

Smooth and Sparse Optimal Transport

2017-10-17 · Mathieu Blondel, Vivien Seguy, Antoine Rolet

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the Sinkhorn algorithm. However, entropy keeps the transportation plan strictly positive and therefore completely dense, unlike unregularized OT. This lack of sparsity can be problematic in applications where the transportation plan itself is of interest. In this paper, we explore regularizing the primal and dual OT formulations with a strongly convex term, which corresponds to relaxing the dual and primal constraints with smooth approximations. We show how to incorporate squared $2$-norm and group lasso regularizations within that framework, leading to sparse and group-sparse transportation plans. On the theoretical side, we bound the approximation error introduced by regularizing the primal and dual formulations. Our results suggest that, for the regularized primal, the approximation error can often be smaller with squared $2$-norm than with entropic regularization. We showcase our proposed framework on the task of color transfer.

📄 PDF Abstract BibTeX arXiv:1710.06276

Code (1)

mblondel/smooth-ot 공식 구현

Similar Papers 제목 키워드 기반

Sparsity-Constrained Optimal Transport

2022-09-30 · Tianlin Liu, Joan Puigcerver, Mathieu Blondel

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportat…

Mixture-of-Experts

Optimal Image Transport on Sparse Dictionaries

2023-11-03 · Junqing Huang, Haihui Wang, Andreas Weiermann, Michael Ruzhansky

In this paper, we derive a novel optimal image transport algorithm over sparse dictionaries by taking advantage of Sparse Representation (SR) and Optimal Transport (OT). Concisely, we design a unified optimization framew…

Image-to-Image TranslationStyle Transfer

Convex Smoothed Autoencoder-Optimal Transport model

2021-01-14 · Aratrika Mustafi

Generative modelling is a key tool in unsupervised machine learning which has achieved stellar success in recent years. Despite this huge success, even the best generative models such as Generative Adversarial Networks (…

model

Optimal Transport with Tempered Exponential Measures

2023-09-07 · Ehsan Amid, Frank Nielsen, Richard Nock, Manfred K. Warmuth

In the field of optimal transport, two prominent subfields face each other: (i) unregularized optimal transport, "\`a-la-Kantorovich", which leads to extremely sparse plans but with algorithms that scale poorly, and (ii)…

Efficient Optimal Transport Algorithm by Accelerated Gradient descent

2021-04-12 · Dongsheng An, Na lei, Xianfeng GU

Optimal transport (OT) plays an essential role in various areas like machine learning and deep learning. However, computing discrete optimal transport plan for large scale problems with adequate accuracy and efficiency i…