Generating Training Data for Denoising Real RGB Images via Camera Pipeline Simulation
Image reconstruction techniques such as denoising often need to be applied to the RGB output of cameras and cellphones. Unfortunately, the commonly used additive white noise (AWGN) models do not accurately reproduce the noise and the degradation encountered on these inputs. This is particularly important for learning-based techniques, because the mismatch between training and real world data will hurt their generalization. This paper aims to accurately simulate the degradation and noise transformation performed by camera pipelines. This allows us to generate realistic degradation in RGB images that can be used to train machine learning models. We use our simulation to study the importance of noise modeling for learning-based denoising. Our study shows that a realistic noise model is required for learning to denoise real JPEG images. A neural network trained on realistic noise outperforms the one trained with AWGN by 3 dB. An ablation study of our pipeline shows that simulating denoising and demosaicking is important to this improvement and that realistic demosaicking algorithms, which have been rarely considered, is needed. We believe this simulation will also be useful for other image reconstruction tasks, and we will distribute our code publicly.
Code (1)
Tasks
DemosaickingDenoisingImage ReconstructionSimilar Papers 제목 키워드 기반
Self-Calibrated Variance-Stabilizing Transformations for Real-World Image Denoising
Supervised deep learning has become the method of choice for image denoising. It involves the training of neural networks on large datasets composed of pairs of noisy and clean images. However, the necessity of training …
DenoisingImage DenoisingHyperspectral Denoising Using Unsupervised Disentangled Spatio-Spectral Deep Priors
Image denoising is often empowered by accurate prior information. In recent years, data-driven neural network priors have shown promising performance for RGB natural image denoising. Compared to classic handcrafted prior…
DenoisingImage DenoisingSelf-supervised training of deep denoisers in multi-coil MRI considering noise correlations
Deep learning-based denoising methods have shown powerful results for improving the signal-to-noise ratio of magnetic resonance (MR) images, mostly by leveraging supervised learning with clean ground truth. However, acqu…
DenoisingImage DenoisingBlind-Spot Guided Diffusion for Self-supervised Real-World Denoising
In this work, we present Blind-Spot Guided Diffusion, a novel self-supervised framework for real-world image denoising. Our approach addresses two major challenges: the limitations of blind-spot networks (BSNs), which of…
Image DenoisingHigh-Quality Real-Time Rendering Using Subpixel Sampling Reconstruction
Generating high-quality, realistic rendering images for real-time applications generally requires tracing a few samples-per-pixel (spp) and using deep learning-based approaches to denoise the resulting low-spp images. Ex…
2kDenoising