paper-with-me

홈 › Papers

Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps

2026-02-13 · Sangwoo Jo, Sungjoon Choi arxiv

Diffusion-based generative models have achieved remarkable performance across various domains, yet their practical deployment is often limited by high sampling costs. While prior work focuses on training objectives or individual solvers, the holistic design of sampling, specifically solver selection and scheduling, remains dominated by static heuristics. In this work, we revisit this challenge through a geometric lens, proposing SDM, a principled framework that aligns the numerical solver with the intrinsic properties of the diffusion trajectory. By analyzing the ODE dynamics, we show that efficient low-order solvers suffice in early high-noise stages while higher-order solvers can be progressively deployed to handle the increasing non-linearity of later stages. Furthermore, we formalize the scheduling by introducing a Wasserstein-bounded optimization framework. This method systematically derives adaptive timesteps that explicitly bound the local discretization error, ensuring the sampling process remains faithful to the underlying continuous dynamics. Without requiring additional training or architectural modifications, SDM achieves state-of-the-art performance across standard benchmarks, including an FID of 1.93 on CIFAR-10, 2.41 on FFHQ, and 1.98 on AFHQv2, with a reduced number of function evaluations compared to existing samplers. Our code is available at https://github.com/aiimaginglab/sdm.

📄 PDF Abstract BibTeX arXiv:2602.12624

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hierarchical Koopman Diffusion: Fast Generation with Interpretable Diffusion Trajectory

2025-10-14 · Hanru Bai, Weiyang Ding, Difan Zou arxiv

Diffusion models have achieved impressive success in high-fidelity image generation but suffer from slow sampling due to their inherently iterative denoising process. While recent one-step methods accelerate inference by…

Image Generation

Elucidating the Design Space of Diffusion-Based Generative Models

2022-06-01 · Tero Karras, Miika Aittala, Timo Aila, Samuli Laine

We argue that the theory and practice of diffusion-based generative models are currently unnecessarily convoluted and seek to remedy the situation by presenting a design space that clearly separates the concrete design c…

Image Generation

Protein Design with Guided Discrete Diffusion

2023-05-31 · NeurIPS 2023 11 · Nate Gruver, Samuel Stanton, Nathan C. Frey, Tim G. J. Rudner 외

A popular approach to protein design is to combine a generative model with a discriminative model for conditional sampling. The generative model samples plausible sequences while the discriminative model guides a search …

Bayesian OptimizationDenoisingProtein Design

Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning

2026-07-06 · Idan Lev-Yehudi, Vadim Indelman arxiv

Planning under uncertainty in continuous domains is essential for autonomous systems, yet computationally demanding. Tree-based search methods such as Monte Carlo Tree Search (MCTS) remain popular, but their branching st…

Learning to Discretize Denoising Diffusion ODEs

2024-05-24 · Vinh Tong, Hoang Trung-Dung, Anji Liu, Guy Van Den Broeck 외

Diffusion Probabilistic Models (DPMs) are generative models showing competitive performance in various domains, including image synthesis and 3D point cloud generation. Sampling from pre-trained DPMs involves multiple ne…

DenoisingImage GenerationPoint Cloud Generation