paper-with-me

홈 › Papers

Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising

2023-09-19 · Yujin Wang, Lingen Li, Tianfan Xue, Jinwei Gu

Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce over-smoothed and blurry images. Recently, researchers have explored diffusion models to generate high-frequency details in image restoration tasks, but these models do not guarantee that the generated texture aligns with real images, leading to undesirable artifacts. To address the trade-off between visual appeal and fidelity of high-frequency details in denoising tasks, we propose a novel approach called the Reconstruct-and-Generate Diffusion Model (RnG). Our method leverages a reconstructive denoising network to recover the majority of the underlying clean signal, which serves as the initial estimation for subsequent steps to maintain fidelity. Additionally, it employs a diffusion algorithm to generate residual high-frequency details, thereby enhancing visual quality. We further introduce a two-stage training scheme to ensure effective collaboration between the reconstructive and generative modules of RnG. To reduce undesirable texture introduced by the diffusion model, we also propose an adaptive step controller that regulates the number of inverse steps applied by the diffusion model, allowing control over the level of high-frequency details added to each patch as well as saving the inference computational cost. Through our proposed RnG, we achieve a better balance between perception and distortion. We conducted extensive experiments on both synthetic and real denoising datasets, validating the superiority of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2309.10714

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage DenoisingImage Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-Resolution

2026-03-03 · Aro Kim, Myeongjin Jang, Chaewon Moon, Youngjin Shin 외 arxiv

Diffusion-based approaches have recently driven remarkable progress in real-world image super-resolution (SR). However, existing methods still struggle to simultaneously preserve fine details and ensure high-fidelity rec…

Image Super-Resolution

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

2023-03-07 · Cindy M. Nguyen, Eric R. Chan, Alexander W. Bergman, Gordon Wetzstein

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-fr…

Image ReconstructionScene Text Recognition

A Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction

2023-05-16 · Ruoqi Wang, Zhuoyang Chen, Qiong Luo, Feng Wang

In radio astronomy, signals from radio telescopes are transformed into images of observed celestial objects, or sources. However, these images, called dirty images, contain real sources as well as artifacts due to signal…

AstronomyDenoisingImage GenerationImage Reconstruction

GR-Diffusion: 3D Gaussian Representation Meets Diffusion in Whole-Body PET Reconstruction

2026-02-12 · Mengxiao Geng, Zijie Chen, Ran Hong, Bingxuan Li 외 arxiv

Positron emission tomography (PET) reconstruction is a critical challenge in molecular imaging, often hampered by noise amplification, structural blurring, and detail loss due to sparse sampling and the ill-posed nature …

DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Models

2024-05-09 · Mengxiao Geng, Jiahao Zhu, Xiaolin Zhu, Qiqing Liu 외

Detail features of magnetic resonance images play a cru-cial role in accurate medical diagnosis and treatment, as they capture subtle changes that pose challenges for doc-tors when performing precise judgments. However, …

Medical DiagnosisMRI Reconstruction