Noise Estimation for Generative Diffusion Models
Generative diffusion models have emerged as leading models in speech and image generation. However, in order to perform well with a small number of denoising steps, a costly tuning of the set of noise parameters is needed. In this work, we present a simple and versatile learning scheme that can step-by-step adjust those noise parameters, for any given number of steps, while the previous work needs to retune for each number separately. Furthermore, without modifying the weights of the diffusion model, we are able to significantly improve the synthesis results, for a small number of steps. Our approach comes at a negligible computation cost.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage GenerationNoise EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Training
Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity.…
Diffusion-based Generative Prior for Low-Complexity MIMO Channel Estimation
This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural ne…
On Density Estimation with Diffusion Models
Diffusion-based generative models have demonstrated a capacity for perceptually impressive synthesis, but can they also be great likelihood-based models? We answer this in the affirmative, and introduce a family of diffu…
Density EstimationPedestrianDiffusion: Multimodal Generative Denoising and Dense State Estimation for Inertial Navigation
The accuracy of consumer-grade inertial navigation is bottlenecked by the stochastic noise of Micro-Electro-Mechanical Systems (MEMS). Traditional deterministic neural architectures often succumb to ``estimation jitterin…
Integrating Reweighted Least Squares with Plug-and-Play Diffusion Priors for Noisy Image Restoration
Existing plug-and-play image restoration methods typically employ off-the-shelf Gaussian denoisers as proximal operators within classical optimization frameworks based on variable splitting. Recently, denoisers induced b…
Image Restoration