SUD$^2$: Supervision by Denoising Diffusion Models for Image Reconstruction
Many imaging inverse problems$\unicode{x2014}$such as image-dependent in-painting and dehazing$\unicode{x2014}$are challenging because their forward models are unknown or depend on unknown latent parameters. While one can solve such problems by training a neural network with vast quantities of paired training data, such paired training data is often unavailable. In this paper, we propose a generalized framework for training image reconstruction networks when paired training data is scarce. In particular, we demonstrate the ability of image denoising algorithms and, by extension, denoising diffusion models to supervise network training in the absence of paired training data.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingImage ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as…
3D Generation3D ReconstructionDenoisingImage Denoising+3Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction
We propose a novel and unified method, measurement-conditioned denoising diffusion probabilistic model (MC-DDPM), for under-sampled medical image reconstruction based on DDPM. Different from previous works, MC-DDPM is de…
DenoisingImage ReconstructionMRI ReconstructionFew-shot point cloud reconstruction and denoising via learned Guassian splats renderings and fine-tuned diffusion features
Existing deep learning methods for the reconstruction and denoising of point clouds rely on small datasets of 3D shapes. We circumvent the problem by leveraging deep learning methods trained on billions of images. We pro…
3D ReconstructionDeep LearningDenoisingPoint cloud reconstructionConditional Denoising Diffusion Model-Based Robust MR Image Reconstruction from Highly Undersampled Data
Magnetic Resonance Imaging (MRI) is a critical tool in modern medical diagnostics, yet its prolonged acquisition time remains a critical limitation, especially in time-sensitive clinical scenarios. While undersampling st…
Image ReconstructionMRI ReconstructionDenoising Diffusion via Image-Based Rendering
Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D r…
3D ReconstructionDenoisingNovel View Synthesis