Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising
Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce over-smoothed and blurry images. Recently, researchers have explored diffusion models to generate high-frequency details in image restoration tasks, but these models do not guarantee that the generated texture aligns with real images, leading to undesirable artifacts. To address the trade-off between visual appeal and fidelity of high-frequency details in denoising tasks, we propose a novel approach called the Reconstruct-and-Generate Diffusion Model (RnG). Our method leverages a reconstructive denoising network to recover the majority of the underlying clean signal, which serves as the initial estimation for subsequent steps to maintain fidelity. Additionally, it employs a diffusion algorithm to generate residual high-frequency details, thereby enhancing visual quality. We further introduce a two-stage training scheme to ensure effective collaboration between the reconstructive and generative modules of RnG. To reduce undesirable texture introduced by the diffusion model, we also propose an adaptive step controller that regulates the number of inverse steps applied by the diffusion model, allowing control over the level of high-frequency details added to each patch as well as saving the inference computational cost. Through our proposed RnG, we achieve a better balance between perception and distortion. We conducted extensive experiments on both synthetic and real denoising datasets, validating the superiority of the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-Resolution
Diffusion-based approaches have recently driven remarkable progress in real-world image super-resolution (SR). However, existing methods still struggle to simultaneously preserve fine details and ensure high-fidelity rec…
Image Super-ResolutionDiffusion in the Dark: A Diffusion Model for Low-Light Text Recognition
Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-fr…
Image ReconstructionScene Text RecognitionA Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction
In radio astronomy, signals from radio telescopes are transformed into images of observed celestial objects, or sources. However, these images, called dirty images, contain real sources as well as artifacts due to signal…
AstronomyDenoisingImage GenerationImage ReconstructionGR-Diffusion: 3D Gaussian Representation Meets Diffusion in Whole-Body PET Reconstruction
Positron emission tomography (PET) reconstruction is a critical challenge in molecular imaging, often hampered by noise amplification, structural blurring, and detail loss due to sparse sampling and the ill-posed nature …
DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Models
Detail features of magnetic resonance images play a cru-cial role in accurate medical diagnosis and treatment, as they capture subtle changes that pose challenges for doc-tors when performing precise judgments. However, …
Medical DiagnosisMRI Reconstruction