paper-with-me

홈 › Papers

Lossy Compression with Gaussian Diffusion

2022-06-17 · Lucas Theis, Tim Salimans, Matthew D. Hoffman, Fabian Mentzer

We consider a novel lossy compression approach based on unconditional diffusion generative models, which we call DiffC. Unlike modern compression schemes which rely on transform coding and quantization to restrict the transmitted information, DiffC relies on the efficient communication of pixels corrupted by Gaussian noise. We implement a proof of concept and find that it works surprisingly well despite the lack of an encoder transform, outperforming the state-of-the-art generative compression method HiFiC on ImageNet 64x64. DiffC only uses a single model to encode and denoise corrupted pixels at arbitrary bitrates. The approach further provides support for progressive coding, that is, decoding from partial bit streams. We perform a rate-distortion analysis to gain a deeper understanding of its performance, providing analytical results for multivariate Gaussian data as well as theoretic bounds for general distributions. Furthermore, we prove that a flow-based reconstruction achieves a 3 dB gain over ancestral sampling at high bitrates.

📄 PDF Abstract BibTeX arXiv:2206.08889

Code (1)

jeremyiv/diffc pytorch

Tasks

Quantization

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Lossy Compression with Pretrained Diffusion Models

2025-01-16 · Jeremy Vonderfecht, Feng Liu

We apply the DiffC algorithm (Theis et al. 2022) to Stable Diffusion 1.5, 2.1, XL, and Flux-dev, and demonstrate that these pretrained models are remarkably capable lossy image compressors. A principled algorithm for los…

Few-step Generative Models as Lossy Compression

2026-06-09 · Fuma Kimishima, Jinjia Zhou arxiv

DiffC provides a principled way to reuse pre-trained diffusion models for lossy compression, but its encoding and decoding procedures remain slow because they require many discretized forward and reverse steps. We study …

Learned Lossless Image Compression With Combined Autoregressive Models And Attention Modules

2022-08-30 · Ran Wang, Jinming Liu, Heming Sun, Jiro Katto

Lossless image compression is an essential research field in image compression. Recently, learning-based image compression methods achieved impressive performance compared with traditional lossless methods, such as WebP,…

Image Compression

Training-Free Rate-Distortion-Perception Traversal With Diffusion

2026-03-04 · Yuhan Wang, Suzhi Bi, Ying-Jun Angela Zhang arxiv

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression met…

Compressed Image Generation with Denoising Diffusion Codebook Models

2025-02-03 · Guy Ohayon, Hila Manor, Tomer Michaeli, Michael Elad

We present a novel generative approach based on Denoising Diffusion Models (DDMs), which produces high-quality image samples along with their losslessly compressed bit-stream representations. This is obtained by replacin…

Conditional Image GenerationDenoisingDiversityImage Compression+2