paper-with-me

Papers

Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise

2022-08-19 · NeurIPS 2023 11 · Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie S. Li, Hamid Kazemi, Furong Huang, Micah Goldblum, Jonas Geiping, Tom Goldstein

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongly dependent on the choice of image degradation, and in fact an entire family of generative models can be constructed by varying this choice. Even when using completely deterministic degradations (e.g., blur, masking, and more), the training and test-time update rules that underlie diffusion models can be easily generalized to create generative models. The success of these fully deterministic models calls into question the community's understanding of diffusion models, which relies on noise in either gradient Langevin dynamics or variational inference, and paves the way for generalized diffusion models that invert arbitrary processes. Our code is available at https://github.com/arpitbansal297/Cold-Diffusion-Models

📄 PDF Abstract BibTeX arXiv:2208.09392

Code (2)

arpitbansal297/cold-diffusion-models 공식 구현 pytorch
lucidrains/denoising-diffusion-pytorch pytorch

Tasks

Image RestorationVariational Inference

Similar Papers 제목 키워드 기반

Learning to Reconstruct Accelerated MRI Through K-space Cold Diffusion without Noise

2023-11-16 · Guoyao Shen, Mengyu Li, Chad W. Farris, Stephan Anderson 외

Deep learning-based MRI reconstruction models have achieved superior performance these days. Most recently, diffusion models have shown remarkable performance in image generation, in-painting, super-resolution, image edi…

Deep LearningImage GenerationMRI ReconstructionSuper-Resolution

Cold Diffusion for Speech Enhancement

2022-11-04 · Hao Yen, François G. Germain, Gordon Wichern, Jonathan Le Roux

Diffusion models have recently shown promising results for difficult enhancement tasks such as the conditional and unconditional restoration of natural images and audio signals. In this work, we explore the possibility o…

Speech Enhancement

Tree-Rings Watermarks: Invisible Fingerprints for Diffusion Images

2023-09-21 · NeurIPS 2023 11

Watermarking the outputs of generative models is a crucial technique for tracing copyright and preventing potential harm from AI-generated content. In this paper, we introduce a novel technique called Tree-Ring Watermark…

Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models

2024-12-04 · CVPR 2025 1 · Andreas Müller, Denis Lukovnikov, Jonas Thietke, Asja Fischer 외

Integrating watermarking into the generation process of latent diffusion models (LDMs) simplifies detection and attribution of generated content. Semantic watermarks, such as Tree-Rings and Gaussian Shading, represent a …

Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust

2023-05-31 · Yuxin Wen, John Kirchenbauer, Jonas Geiping, Tom Goldstein

Watermarking the outputs of generative models is a crucial technique for tracing copyright and preventing potential harm from AI-generated content. In this paper, we introduce a novel technique called Tree-Ring Watermark…

Image Generation