paper-with-me

Papers

Underdamped Diffusion Bridges with Applications to Sampling

2025-03-02 · Denis Blessing, Julius Berner, Lorenz Richter, Gerhard Neumann

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices, where the noise only acts in certain dimensions. Extending previous findings, our framework allows to rigorously show that score matching in the underdamped case is indeed equivalent to maximizing a lower bound on the likelihood. Motivated by superior convergence properties and compatibility with sophisticated numerical integration schemes of underdamped stochastic processes, we propose \emph{underdamped diffusion bridges}, where a general density evolution is learned rather than prescribed by a fixed noising process. We apply our method to the challenging task of sampling from unnormalized densities without access to samples from the target distribution. Across a diverse range of sampling problems, our approach demonstrates state-of-the-art performance, notably outperforming alternative methods, while requiring significantly fewer discretization steps and no hyperparameter tuning.

📄 PDF Abstract BibTeX arXiv:2503.01006

Code (1)

DenisBless/UnderdampedDiffusionBridges 공식 구현 jax

Tasks

Numerical Integration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Stochastic Zeroth-order Discretizations of Langevin Diffusions for Bayesian Inference

2019-02-04 · Abhishek Roy, Lingqing Shen, Krishnakumar Balasubramanian, Saeed Ghadimi

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scen…

Bayesian InferenceStochastic OptimizationVariable Selection

Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing

2026-04-20 · Kijung Jeon, Michael Muehlebach, Molei Tao arxiv

Generative modeling within constrained sets is essential for scientific and engineering applications involving physical, geometric, or safety requirements (e.g., molecular generation, robotics). We present a unified fram…

Error estimates between SGD with momentum and underdamped Langevin diffusion

2024-10-22 · Arnaud Guillin, Yu Wang, Lihu Xu, Haoran Yang

Stochastic gradient descent with momentum is a popular variant of stochastic gradient descent, which has recently been reported to have a close relationship with the underdamped Langevin diffusion. In this paper, we esta…

Improved Discretization Analysis for Underdamped Langevin Monte Carlo

2023-02-16 · Matthew Zhang, Sinho Chewi, Mufan Bill Li, Krishnakumar Balasubramanian 외

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by tw…

Underdamped Langevin MCMC with third order convergence

2025-08-22 · Maximilian Scott, Dáire O'Kane, Andraž Jelinčič, James Foster arxiv

In this paper, we propose a new numerical method for the underdamped Langevin diffusion (ULD) and present a non-asymptotic analysis of its sampling error in the 2-Wasserstein distance when the $d$-dimensional target dist…