paper-with-me

Papers

Efficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolution

2024-04-16 · Yutao Yuan, Chun Yuan

Image super-resolution is a fundamentally ill-posed problem because multiple valid high-resolution images exist for one low-resolution image. Super-resolution methods based on diffusion probabilistic models can deal with the ill-posed nature by learning the distribution of high-resolution images conditioned on low-resolution images, avoiding the problem of blurry images in PSNR-oriented methods. However, existing diffusion-based super-resolution methods have high time consumption with the use of iterative sampling, while the quality and consistency of generated images are less than ideal due to problems like color shifting. In this paper, we propose Efficient Conditional Diffusion Model with Probability Flow Sampling (ECDP) for image super-resolution. To reduce the time consumption, we design a continuous-time conditional diffusion model for image super-resolution, which enables the use of probability flow sampling for efficient generation. Additionally, to improve the consistency of generated images, we propose a hybrid parametrization for the denoiser network, which interpolates between the data-predicting parametrization and the noise-predicting parametrization for different noise scales. Moreover, we design an image quality loss as a complement to the score matching loss of diffusion models, further improving the consistency and quality of super-resolution. Extensive experiments on DIV2K, ImageNet, and CelebA demonstrate that our method achieves higher super-resolution quality than existing diffusion-based image super-resolution methods while having lower time consumption. Our code is available at https://github.com/Yuan-Yutao/ECDP.

📄 PDF Abstract BibTeX arXiv:2404.10688

Code (1)

yuan-yutao/ecdp 공식 구현 pytorch

Tasks

Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Flow Matching for Generative Modeling

2022-10-06 · Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel 외

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-…

Density EstimationImage Generation

A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models

2026-08-19 · Libo Chen, Souvik Ghosh, Teo Deveney, Chris Budd 외 arxiv

We propose a conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition. The mechanism learns an unconditional joint score network and enforces conditioning at infere…

Conditional Image Generation

Conditional Stochastic Interpolation for Generative Learning

2023-12-09 · Ding Huang, Jian Huang, Ting Li, Guohao Shen

We propose a conditional stochastic interpolation (CSI) method for learning conditional distributions. CSI is based on estimating probability flow equations or stochastic differential equations that transport a reference…

Image Generation

Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion

2023-10-01 · Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata 외

Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Cons…

DenoisingImage Generation

PPFM: Image denoising in photon-counting CT using single-step posterior sampling Poisson flow generative models

2023-12-15 · Dennis Hein, Staffan Holmin, Timothy Szczykutowicz, Jonathan S Maltz 외

Diffusion and Poisson flow models have shown impressive performance in a wide range of generative tasks, including low-dose CT image denoising. However, one limitation in general, and for clinical applications in particu…

DenoisingImage Denoising