paper-with-me

Papers

Improving Diffusion-Based Generative Models via Approximated Optimal Transport

2024-03-08 · Daegyu Kim, Jooyoung Choi, Chaehun Shin, Uiwon Hwang, Sungroh Yoon

We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, significantly enhancing the ability of diffusion models to estimate the denoiser outputs accurately. This improvement leads to ODE trajectories of diffusion models with lower curvature and reduced truncation errors during sampling. We achieve superior image quality and reduced sampling steps by employing AOT in training. Specifically, we achieve FID scores of 1.88 with just 27 NFEs and 1.73 with 29 NFEs in unconditional and conditional generations, respectively. Furthermore, when applying AOT to train the discriminator for guidance, we establish new state-of-the-art FID scores of 1.68 and 1.58 for unconditional and conditional generations, respectively, each with 29 NFEs. This outcome demonstrates the effectiveness of AOT in enhancing the performance of diffusion models.

📄 PDF Abstract BibTeX arXiv:2403.05069

Code (1)

large-scale-kim/EDM-AOT 공식 구현 pytorch

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Normalizing flows as approximations of optimal transport maps via linear-control neural ODEs

2023-11-02 · Alessandro Scagliotti, Sara Farinelli

In this paper, we consider the problem of recovering the $W_2$-optimal transport map T between absolutely continuous measures $\mu,\nu\in\mathcal{P}(\mathbb{R}^n)$ as the flow of a linear-control neural ODE, where the co…

Notes on generative modeling: flow matching, diffusion, optimal transport and Schr{ö}dinger bridge

2026-06-29 · Titouan Vayer arxiv

These notes recapitulate the high level mathematical principles behind different techniques for generative modeling. I show the connections between optimal transport and standard techniques such as Schr{ö}dinger bridge a…

Provably Convergent Schrödinger Bridge with Applications to Probabilistic Time Series Imputation

2023-05-12 · Yu Chen, Wei Deng, Shikai Fang, Fengpei Li 외

The Schr\"odinger bridge problem (SBP) is gaining increasing attention in generative modeling and showing promising potential even in comparison with the score-based generative models (SGMs). SBP can be interpreted as an…

ImputationMissing ValuesTime Series

Non-Denoising Forward-Time Diffusions

2023-12-22 · Stefano Peluchetti

The scope of this paper is generative modeling through diffusion processes. An approach falling within this paradigm is the work of Song et al. (2021), which relies on a time-reversal argument to construct a diffusion pr…

Denoising

The Fundamental Limits of Valid Transport Map Estimation

2026-06-29 · Sivaraman Balakrishnan arxiv

Many modern generative modeling methods, including diffusion models, normalizing flows, and flow matching, estimate transport maps or plans between distributions without explicitly targeting an optimal transport (OT) map…