paper-with-me

Papers

Modeling sRGB Camera Noise with Normalizing Flows

2022-06-02 · CVPR 2022 1 · Shayan Kousha, Ali Maleky, Michael S. Brown, Marcus A. Brubaker

Noise modeling and reduction are fundamental tasks in low-level computer vision. They are particularly important for smartphone cameras relying on small sensors that exhibit visually noticeable noise. There has recently been renewed interest in using data-driven approaches to improve camera noise models via neural networks. These data-driven approaches target noise present in the raw-sensor image before it has been processed by the camera's image signal processor (ISP). Modeling noise in the RAW-rgb domain is useful for improving and testing the in-camera denoising algorithm; however, there are situations where the camera's ISP does not apply denoising or additional denoising is desired when the RAW-rgb domain image is no longer available. In such cases, the sensor noise propagates through the ISP to the final rendered image encoded in standard RGB (sRGB). The nonlinear steps on the ISP culminate in a significantly more complex noise distribution in the sRGB domain and existing raw-domain noise models are unable to capture the sRGB noise distribution. We propose a new sRGB-domain noise model based on normalizing flows that is capable of learning the complex noise distribution found in sRGB images under various ISO levels. Our normalizing flows-based approach outperforms other models by a large margin in noise modeling and synthesis tasks. We also show that image denoisers trained on noisy images synthesized with our noise model outperforms those trained with noise from baselines models.

📄 PDF Abstract BibTeX arXiv:2206.00812

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

NM-FlowGAN: Modeling sRGB Noise without Paired Images using a Hybrid Approach of Normalizing Flows and GAN

2023-12-15 · Young Joo Han, Ha-Jin Yu

Modeling and synthesizing real sRGB noise is crucial for various low-level vision tasks, such as building datasets for training image denoising systems. The distribution of real sRGB noise is highly complex and affected …

DenoisingImage DenoisingImage RestorationNoise Estimation+1

Noise Flow: Noise Modeling with Conditional Normalizing Flows

2019-08-22 · ICCV 2019 10 · Abdelrahman Abdelhamed, Marcus A. Brubaker, Michael S. Brown

Modeling and synthesizing image noise is an important aspect in many computer vision applications. The long-standing additive white Gaussian and heteroscedastic (signal-dependent) noise models widely used in the literatu…

Image Denoising

DualDn: Dual-domain Denoising via Differentiable ISP

2024-09-27 · Ruikang Li, Yujin Wang, Shiqi Chen, Fan Zhang 외

Image denoising is a critical component in a camera's Image Signal Processing (ISP) pipeline. There are two typical ways to inject a denoiser into the ISP pipeline: applying a denoiser directly to captured raw frames (ra…

DenoisingImage Denoising

sRGB Real Noise Synthesizing With Neighboring Correlation-Aware Noise Model

2023-01-01 · CVPR 2023 1 · Zixuan Fu, Lanqing Guo, Bihan Wen

Modeling and synthesizing real noise in the standard RGB (sRGB) domain is challenging due to the complicated noise distribution. While most of the deep noise generators proposed to synthesize sRGB real noise using an…

Denoising

BSRAW: Improving Blind RAW Image Super-Resolution

2023-12-24 · Marcos V. Conde, Florin Vasluianu, Radu Timofte

In smartphones and compact cameras, the Image Signal Processor (ISP) transforms the RAW sensor image into a human-readable sRGB image. Most popular super-resolution methods depart from a sRGB image and upscale it further…

Image Super-ResolutionSuper-Resolution