Constrained Diffusion Implicit Models

2024-11-01 · Vivek Jayaram, Ira Kemelmacher-Shlizerman, Steven M. Seitz, John Thickstun

This paper describes an efficient algorithm for solving noisy linear inverse problems using pretrained diffusion models. Extending the paradigm of denoising diffusion implicit models (DDIM), we propose constrained diffusion implicit models (CDIM) that modify the diffusion updates to enforce a constraint upon the final output. For noiseless inverse problems, CDIM exactly satisfies the constraints; in the noisy case, we generalize CDIM to satisfy an exact constraint on the residual distribution of the noise. Experiments across a variety of tasks and metrics show strong performance of CDIM, with analogous inference acceleration to unconstrained DDIM: 10 to 50 times faster than previous conditional diffusion methods. We demonstrate the versatility of our approach on many problems including super-resolution, denoising, inpainting, deblurring, and 3D point cloud reconstruction.

📄 PDF Abstract BibTeX arXiv:2411.00359

Code (0)

등록된 구현이 없습니다.

Tasks

3D Point Cloud ReconstructionDeblurring DenoisingPoint cloud reconstructionSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Diffusion Beats Autoregressive in Data-Constrained Settings

2025-07-21 · Mihir Prabhudesai, Mengning Wu, Amir Zadeh, Katerina Fragkiadaki 외 arxiv

Autoregressive (AR) models have long dominated the landscape of large language models, driving progress across a wide range of tasks. Recently, diffusion-based language models have emerged as a promising alternative, tho…

Data Augmentation

Neural Message Passing Induced by Energy-Constrained Diffusion

2024-09-13 · Qitian Wu, David Wipf, Junchi Yan

Learning representations for structured data with certain geometries (observed or unobserved) is a fundamental challenge, wherein message passing neural networks (MPNNs) have become a de facto class of model solutions. I…

Inductive Bias

DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraints

2023-01-22 · Zhangyang Gao, Cheng Tan, Stan Z. Li

Have you ever been troubled by the complexity and computational cost of SE(3) protein structure modeling and been amazed by the simplicity and power of language modeling? Recent work has shown promise in simplifying prot…

Decoder Denoising Language Modeling Language Modelling

Topology-Aware Latent Diffusion for 3D Shape Generation

2024-01-31 · Jiangbei Hu, Ben Fei, Baixin Xu, Fei Hou 외

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves repre…

3D Shape Generation Diversity Navigate

DyWeight: Dynamic Gradient Weighting for Few-Step Diffusion Sampling

2026-03-12 · Tong Zhao, Mingkun Lei, Liangyu Yuan, Yanming Yang 외 arxiv

Diffusion Models (DMs) have achieved state-of-the-art generative performance across multiple modalities, yet their sampling process remains prohibitively slow due to the need for hundreds of function evaluations. Recent …