Improving Denoising Diffusion Models via Simultaneous Estimation of Image and Noise
This paper introduces two key contributions aimed at improving the speed and quality of images generated through inverse diffusion processes. The first contribution involves reparameterizing the diffusion process in terms of the angle on a quarter-circular arc between the image and noise, specifically setting the conventional $\displaystyle \sqrt{\bar{\alpha}}=\cos(\eta)$. This reparameterization eliminates two singularities and allows for the expression of diffusion evolution as a well-behaved ordinary differential equation (ODE). In turn, this allows higher order ODE solvers such as Runge-Kutta methods to be used effectively. The second contribution is to directly estimate both the image ($\mathbf{x}_0$) and noise ($\mathbf{\epsilon}$) using our network, which enables more stable calculations of the update step in the inverse diffusion steps, as accurate estimation of both the image and noise are crucial at different stages of the process. Together with these changes, our model achieves faster generation, with the ability to converge on high-quality images more quickly, and higher quality of the generated images, as measured by metrics such as Frechet Inception Distance (FID), spatial Frechet Inception Distance (sFID), precision, and recall.
Code (0)
등록된 구현이 없습니다.
Tasks
ARCDenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explicit Diffusion of Gaussian Mixture Model Based Image Priors
In this work we tackle the problem of estimating the density $f_X$ of a random variable $X$ by successive smoothing, such that the smoothed random variable $Y$ fulfills $(\partial_t - \Delta_1)f_Y(\,\cdot\,, t) = 0$, $f_…
DenoisingImage DenoisingNoise Estimation6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation
Estimating the 6D object pose from a single RGB image often involves noise and indeterminacy due to challenges such as occlusions and cluttered backgrounds. Meanwhile, diffusion models have shown appealing performance in…
6D Pose Estimation using RGBDenoisingObjectPose EstimationSimultaneous Image-to-Zero and Zero-to-Noise: Diffusion Models with Analytical Image Attenuation
Recent studies have demonstrated that the forward diffusion process is crucial for the effectiveness of diffusion models in terms of generative quality and sampling efficiency. We propose incorporating an analytical imag…
DenoisingEdge DetectionImage GenerationImage Inpainting+2Product of Gaussian Mixture Diffusion Models
In this work we tackle the problem of estimating the density $ f_X $ of a random variable $ X $ by successive smoothing, such that the smoothed random variable $ Y $ fulfills the diffusion partial differential equation $…
DenoisingImage DenoisingNoise EstimationBootstrap Diffusion Model Curve Estimation for High Resolution Low-Light Image Enhancement
Learning-based methods have attracted a lot of research attention and led to significant improvements in low-light image enhancement. However, most of them still suffer from two main problems: expensive computational cos…
DenoisingImage EnhancementLow-Light Image Enhancement