Conditioning diffusion models by explicit forward-backward bridging
Given an unconditional diffusion model targeting a joint model $\pi(x, y)$, using it to perform conditional simulation $\pi(x \mid y)$ is still largely an open question and is typically achieved by learning conditional drifts to the denoising SDE after the fact. In this work, we express \emph{exact} conditional simulation within the \emph{approximate} diffusion model as an inference problem on an augmented space corresponding to a partial SDE bridge. This perspective allows us to implement efficient and principled particle Gibbs and pseudo-marginal samplers marginally targeting the conditional distribution $\pi(x \mid y)$. Contrary to existing methodology, our methods do not introduce any additional approximation to the unconditional diffusion model aside from the Monte Carlo error. We showcase the benefits and drawbacks of our approach on a series of synthetic and real data examples.
Code (1)
Tasks
DenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Forward Backward SDEs Systems for Utility Maximization in Jump Diffusion Models
We consider the classical problem of maximizing the expected utility of terminal net wealth with a final random liability in a simple jump-diffusion model. In the spirit of Horst et al. (2014) and Santacroce-Trivellato (…
Enhancing Dance-to-Music Generation via Negative Conditioning Latent Diffusion Model
Conditional diffusion models have gained increasing attention since their impressive results for cross-modal synthesis, where the strong alignment between conditioning input and generated output can be achieved by traini…
Music GenerationOn learning higher-order cumulants in diffusion models
To analyse how diffusion models learn correlations beyond Gaussian ones, we study the behaviour of higher-order cumulants, or connected n-point functions, under both the forward and backward process. We derive explicit e…
KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image
Satellite image inpainting is a crucial task in remote sensing, where accurately restoring missing or occluded regions is essential for robust image analysis. In this paper, we propose KAO, a novel framework that utilize…
Image RestorationImage InpaintingExploring Time Conditioning in Diffusion Generative Models from Disjoint Noisy Data Manifolds
Practically, training diffusion models typically requires explicit time conditioning to guide the network through the denoising sampling process. Especially in deterministic methods like DDIM, the absence of time conditi…