paper-with-me

Papers

An Ordinary Differential Equation Sampler with Stochastic Start for Diffusion Bridge Models

2024-12-28 · Yuang Wang, Pengfei Jin, Li Zhang, Quanzheng Li, Zhiqiang Chen, Dufan Wu

Diffusion bridge models have demonstrated promising performance in conditional image generation tasks, such as image restoration and translation, by initializing the generative process from corrupted images instead of pure Gaussian noise. However, existing diffusion bridge models often rely on Stochastic Differential Equation (SDE) samplers, which result in slower inference speed compared to diffusion models that employ high-order Ordinary Differential Equation (ODE) solvers for acceleration. To mitigate this gap, we propose a high-order ODE sampler with a stochastic start for diffusion bridge models. To overcome the singular behavior of the probability flow ODE (PF-ODE) at the beginning of the reverse process, a posterior sampling approach was introduced at the first reverse step. The sampling was designed to ensure a smooth transition from corrupted images to the generative trajectory while reducing discretization errors. Following this stochastic start, Heun's second-order solver is applied to solve the PF-ODE, achieving high perceptual quality with significantly reduced neural function evaluations (NFEs). Our method is fully compatible with pretrained diffusion bridge models and requires no additional training. Extensive experiments on image restoration and translation tasks, including super-resolution, JPEG restoration, Edges-to-Handbags, and DIODE-Outdoor, demonstrated that our sampler outperforms state-of-the-art methods in both visual quality and Frechet Inception Distance (FID).

📄 PDF Abstract BibTeX arXiv:2412.19992

Code (0)

등록된 구현이 없습니다.

Tasks

Conditional Image GenerationImage GenerationImage RestorationSuper-ResolutionTranslation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Finite-Time Analysis of Discrete-Time Stochastic Interpolants

2025-02-13 · Yuhao Liu, Yu Chen, Rui Hu, Longbo Huang

The stochastic interpolant framework offers a powerful approach for constructing generative models based on ordinary differential equations (ODEs) or stochastic differential equations (SDEs) to transform arbitrary data d…

Sampling via Stochastic Interpolants by Langevin-based Velocity and Initialization Estimation in Flow ODEs

2026-01-13 · Chenguang Duan, Yuling Jiao, Gabriele Steidl, Christian Wald 외 arxiv

We propose a novel method for sampling from unnormalized Boltzmann densities based on a probability flow ordinary differential equation (ODE) derived from linear stochastic interpolants. The key innovation of our approac…

Bayesian Inference

Deterministic Gibbs Sampling via Ordinary Differential Equations

2021-06-18 · Kirill Neklyudov, Roberto Bondesan, Max Welling

Deterministic dynamics is an essential part of many MCMC algorithms, e.g. Hybrid Monte Carlo or samplers utilizing normalizing flows. This paper presents a general construction of deterministic measure-preserving dynamic…

Stochastic Sampling from Deterministic Flow Models

2024-10-03 · Saurabh Singh, Ian Fischer

Deterministic flow models, such as rectified flows, offer a general framework for learning a deterministic transport map between two distributions, realized as the vector field for an ordinary differential equation (ODE)…

Diversity

Introduction to Stochastic Differential Equations for Generative Machine Learning: A Variational Perspective

2026-06-30 · Ole Winther, Paul Jeha, Sander Dieleman, Andriy Mnih 외 arxiv

The use of ordinary and stochastic differential equations has led to substantial progress in generative machine learning with applications to, for example, image, video and biomolecule generation. This paper provides a s…