paper-with-me

Papers

Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis

2022-03-24 · Kai Zhang, Yawei Li, Jingyun Liang, JieZhang Cao, Yulun Zhang, Hao Tang, Deng-Ping Fan, Radu Timofte, Luc van Gool

While recent years have witnessed a dramatic upsurge of exploiting deep neural networks toward solving image denoising, existing methods mostly rely on simple noise assumptions, such as additive white Gaussian noise (AWGN), JPEG compression noise and camera sensor noise, and a general-purpose blind denoising method for real images remains unsolved. In this paper, we attempt to solve this problem from the perspective of network architecture design and training data synthesis. Specifically, for the network architecture design, we propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block, and then plug it as the main building block into the widely-used image-to-image translation UNet architecture. For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise (including Gaussian, Poisson, speckle, JPEG compression, and processed camera sensor noises) and resizing, and also involves a random shuffle strategy and a double degradation strategy. Extensive experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance and the new degradation model can help to significantly improve the practicability. We believe our work can provide useful insights into current denoising research.

📄 PDF Abstract BibTeX arXiv:2203.13278

Code (2)

cszn/scunet 공식 구현 pytorch
zhuangpeiyu/reloc pytorch

Tasks

DenoisingImage DenoisingImage-to-Image Translation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…

Similar Papers 제목 키워드 기반

SwinIA: Self-Supervised Blind-Spot Image Denoising without Convolutions

2023-05-09 · Mikhail Papkov, Pavel Chizhov, Leopold Parts

Self-supervised image denoising implies restoring the signal from a noisy image without access to the ground truth. State-of-the-art solutions for this task rely on predicting masked pixels with a fully-convolutional neu…

Color Image DenoisingDenoisingGrayscale Image DenoisingImage Denoising+1

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

2022-07-28 · Hao Li, Zhijing Yang, Xiaobin Hong, Ziying Zhao 외

Real-world image denoising is a practical image restoration problem that aims to obtain clean images from in-the-wild noisy inputs. Recently, the Vision Transformer (ViT) has exhibited a strong ability to capture long-ra…

DecoderDenoisingImage DenoisingImage Restoration

Deep Universal Blind Image Denoising

2021-01-18 · Jae Woong Soh, Nam Ik Cho

Image denoising is an essential part of many image processing and computer vision tasks due to inevitable noise corruption during image acquisition. Traditionally, many researchers have investigated image priors for the …

DenoisingImage Denoising

DN-ResNet: Efficient Deep Residual Network for Image Denoising

2018-10-16 · Haoyu Ren, Mostafa El-Khamy, Jungwon Lee

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several resid…

Computational EfficiencyDeep LearningDenoisingImage Denoising+2

Blind Universal Bayesian Image Denoising with Gaussian Noise Level Learning

2019-07-05 · Majed El Helou, Sabine Süsstrunk

Blind and universal image denoising consists of using a unique model that denoises images with any level of noise. It is especially practical as noise levels do not need to be known when the model is developed or at test…

Color Image DenoisingDenoisingImage Denoising