paper-with-me

홈 › Papers

Score-based Generative Neural Networks for Large-Scale Optimal Transport

2021-10-07 · NeurIPS 2021 12 · Max Daniels, Tyler Maunu, Paul Hand

We consider the fundamental problem of sampling the optimal transport coupling between given source and target distributions. In certain cases, the optimal transport plan takes the form of a one-to-one mapping from the source support to the target support, but learning or even approximating such a map is computationally challenging for large and high-dimensional datasets due to the high cost of linear programming routines and an intrinsic curse of dimensionality. We study instead the Sinkhorn problem, a regularized form of optimal transport whose solutions are couplings between the source and the target distribution. We introduce a novel framework for learning the Sinkhorn coupling between two distributions in the form of a score-based generative model. Conditioned on source data, our procedure iterates Langevin Dynamics to sample target data according to the regularized optimal coupling. Key to this approach is a neural network parametrization of the Sinkhorn problem, and we prove convergence of gradient descent with respect to network parameters in this formulation. We demonstrate its empirical success on a variety of large scale optimal transport tasks.

📄 PDF Abstract BibTeX arXiv:2110.03237

Code (1)

mdnls/scones-synthetic pytorch

Tasks

Form

Similar Papers 제목 키워드 기반

On Scalable and Efficient Computation of Large Scale Optimal Transport

2019-05-01 · ICLR Workshop DeepGenStruct 2019 · Yujia Xie, Minshuo Chen, Haoming Jiang, Tuo Zhao 외

Optimal Transport (OT) naturally arises in many machine learning applications, yet the heavy computational burden limits its wide-spread uses. To address the scalability issue, we propose an implicit generative learning-…

Domain Adaptation

Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transport

2023-05-24 · NeurIPS 2023 11 · Jaemoo Choi, Jaewoong Choi, Myungjoo Kang

Optimal Transport (OT) problem investigates a transport map that bridges two distributions while minimizing a given cost function. In this regard, OT between tractable prior distribution and data has been utilized for ge…

Variational Schrödinger Momentum Diffusion

2025-01-28 · Kevin Rojas, Yixin Tan, Molei Tao, Yuriy Nevmyvaka 외

The momentum Schr\"odinger Bridge (mSB) has emerged as a leading method for accelerating generative diffusion processes and reducing transport costs. However, the lack of simulation-free properties inevitably results in …

DenoisingImage Generation

Improving Mini-batch Optimal Transport via Partial Transportation

2021-08-22 · Khai Nguyen, Dang Nguyen, The-Anh Vu-Le, Tung Pham 외

Mini-batch optimal transport (m-OT) has been widely used recently to deal with the memory issue of OT in large-scale applications. Despite their practicality, m-OT suffers from misspecified mappings, namely, mappings tha…

Domain AdaptationPartial Domain Adaptation

Improving Diffusion-Based Generative Models via Approximated Optimal Transport

2024-03-08 · Daegyu Kim, Jooyoung Choi, Chaehun Shin, Uiwon Hwang 외

We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, …

Image Generation