paper-with-me

홈 › Papers

Boosting Diffusion Models with an Adaptive Momentum Sampler

2023-08-23 · Xiyu Wang, Anh-Dung Dinh, Daochang Liu, Chang Xu

Diffusion probabilistic models (DPMs) have been shown to generate high-quality images without the need for delicate adversarial training. However, the current sampling process in DPMs is prone to violent shaking. In this paper, we present a novel reverse sampler for DPMs inspired by the widely-used Adam optimizer. Our proposed sampler can be readily applied to a pre-trained diffusion model, utilizing momentum mechanisms and adaptive updating to smooth the reverse sampling process and ensure stable generation, resulting in outputs of enhanced quality. By implicitly reusing update directions from early steps, our proposed sampler achieves a better balance between high-level semantics and low-level details. Additionally, this sampler is flexible and can be easily integrated into pre-trained DPMs regardless of the sampler used during training. Our experimental results on multiple benchmarks demonstrate that our proposed reverse sampler yields remarkable improvements over different baselines. We will make the source code available.

📄 PDF Abstract BibTeX arXiv:2308.11941

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Adam 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models

2024-10-03 · Seyedmorteza Sadat, Otmar Hilliges, Romann M. Weber

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance…

GIST: Gibbs self-tuning for locally adaptive Hamiltonian Monte Carlo

2024-04-23 · Nawaf Bou-Rabee, Bob Carpenter, Milo Marsden

We introduce a novel and flexible framework for constructing locally adaptive Hamiltonian Monte Carlo (HMC) samplers by Gibbs sampling the algorithm's tuning parameters conditionally based on the position and momentum at…

Position

Fast Diffusion Model

2023-06-12 · Zike Wu, Pan Zhou, Kenji Kawaguchi, Hanwang Zhang

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs…

Image Generationmodel

Score-based Generative Models with Adaptive Momentum

2024-05-22 · Ziqing Wen, Xiaoge Deng, Ping Luo, Tao Sun 외

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the re…

DenoisingGraph Generation

Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion

2025-10-06 · Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki 외 arxiv

Masked diffusion models have shown promising performance in generating high-quality samples in a wide range of domains, but accelerating their sampling process remains relatively underexplored. To investigate efficient s…