paper-with-me

Papers

A Mixture-Based Framework for Guiding Diffusion Models

2025-02-05 · Yazid Janati, Badr Moufad, Mehdi Abou El Qassime, Alain Durmus, Eric Moulines, Jimmy Olsson

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time compute and thereby eliminating the need to retrain task-specific models on the same dataset. To approximate the posterior of a Bayesian inverse problem, a diffusion model samples from a sequence of intermediate posterior distributions, each with an intractable likelihood function. This work proposes a novel mixture approximation of these intermediate distributions. Since direct gradient-based sampling of these mixtures is infeasible due to intractable terms, we propose a practical method based on Gibbs sampling. We validate our approach through extensive experiments on image inverse problems, utilizing both pixel- and latent-space diffusion priors, as well as on source separation with an audio diffusion model. The code is available at https://www.github.com/badr-moufad/mgdm

📄 PDF Abstract BibTeX arXiv:2502.03332

Code (1)

badr-moufad/mgdm 공식 구현 jax

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

AudioMoG: Guiding Audio Generation with Mixture-of-Guidance

2025-09-28 · Junyou Wang, Zehua Chen, Binjie Yuan, Kaiwen Zheng 외 arxiv

The design of diffusion-based audio generation systems has been investigated from diverse perspectives, such as data space, network architecture, and conditioning techniques, while most of these innovations require model…

Audio GenerationImage Generation

Path Guiding Using Spatio-Directional Mixture Models

2021-11-25 · Ana Dodik, Marios Papas, Cengiz Öztireli, Thomas Müller

We propose a learning-based method for light-path construction in path tracing algorithms, which iteratively optimizes and samples from what we refer to as spatio-directional Gaussian mixture models (SDMMs). In particula…

Guiding Vector Field Generation via Score-based Diffusion Model

2026-04-27 · Zirui Chen, Shiliang Guo, Shiyu Zhao arxiv

Guiding Vector Fields (GVFs) are a powerful tool for robotic path following. However, classical methods assume smooth, ordered curves and fail when paths are unordered, multi-branch, or generated by probabilistic models.…

Point Clouds

CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Models

2025-03-24 · Weichen Fan, Amber Yijia Zheng, Raymond A. Yeh, Ziwei Liu

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models tra…

From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle Velocity

2025-12-02 · Haoming Liu, Jinnuo Liu, Yanhao Li, Liuyang Bai 외 arxiv

Flow-based diffusion models have emerged as a leading paradigm for training generative models across images and videos. However, their memorization-generalization behavior remains poorly understood. In this work, we revi…