paper-with-me

홈 › Papers

Self-Supervised Image Denoising for Real-World Images with Context-aware Transformer

2023-04-04 · Dan Zhang, Fangfang Zhou

In recent years, the development of deep learning has been pushing image denoising to a new level. Among them, self-supervised denoising is increasingly popular because it does not require any prior knowledge. Most of the existing self-supervised methods are based on convolutional neural networks (CNN), which are restricted by the locality of the receptive field and would cause color shifts or textures loss. In this paper, we propose a novel Denoise Transformer for real-world image denoising, which is mainly constructed with Context-aware Denoise Transformer (CADT) units and Secondary Noise Extractor (SNE) block. CADT is designed as a dual-branch structure, where the global branch uses a window-based Transformer encoder to extract the global information, while the local branch focuses on the extraction of local features with small receptive field. By incorporating CADT as basic components, we build a hierarchical network to directly learn the noise distribution information through residual learning and obtain the first stage denoised output. Then, we design SNE in low computation for secondary global noise extraction. Finally the blind spots are collected from the Denoise Transformer output and reconstructed, forming the final denoised image. Extensive experiments on the real-world SIDD benchmark achieve 50.62/0.990 for PSNR/SSIM, which is competitive with the current state-of-the-art method and only 0.17/0.001 lower. Visual comparisons on public sRGB, Raw-RGB and greyscale datasets prove that our proposed Denoise Transformer has a competitive performance, especially on blurred textures and low-light images, without using additional knowledge, e.g., noise level or noise type, regarding the underlying unknown noise.

📄 PDF Abstract BibTeX arXiv:2304.01627

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage DenoisingSSIM

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network

2022-03-22 · CVPR 2022 1 · Wooseok Lee, Sanghyun Son, Kyoung Mu Lee

Blind-spot network (BSN) and its variants have made significant advances in self-supervised denoising. Nevertheless, they are still bound to synthetic noisy inputs due to less practical assumptions like pixel-wise indepe…

Denoising

Random Sub-Samples Generation for Self-Supervised Real Image Denoising

2023-07-31 · ICCV 2023 1 · Yizhong Pan, Xiao Liu, Xiangyu Liao, Yuanzhouhan Cao 외

With sufficient paired training samples, the supervised deep learning methods have attracted much attention in image denoising because of their superior performance. However, it is still very challenging to widely utiliz…

DenoisingImage Denoising

I2V: Towards Texture-Aware Self-Supervised Blind Denoising using Self-Residual Learning for Real-World Images

2023-02-21 · Kanggeun Lee, Kyungryun Lee, Won-Ki Jeong

Although the advances of self-supervised blind denoising are significantly superior to conventional approaches without clean supervision in synthetic noise scenarios, it shows poor quality in real-world images due to spa…

DenoisingSSIM

Pseudo-Siamese Blind-Spot Transformers for Self-Supervised Real-World Denoising

2025-06-05 · The Annual Conference on Neural Information Processing Systems 2025 6 · Yuhui Quan; Tianxiang Zheng; Hui Ji

Real-world image denoising remains a challenge task. This paper studies self-supervised image denoising, requiring only noisy images captured in a single shot. We revamping the blind-spot technique by leveraging the tran…

DenoisingImage Denoising

Iterative Denoiser and Noise Estimator for Self-Supervised Image Denoising

2023-01-01 · ICCV 2023 1 · Yunhao Zou, Chenggang Yan, Ying Fu

With the emergence of powerful deep learning tools, more and more effective deep denoisers have advanced the field of image denoising. However, the huge progress made by these learning-based methods severely relies o…

DenoisingImage Denoising