SwinIA: Self-Supervised Blind-Spot Image Denoising without Convolutions
Self-supervised image denoising implies restoring the signal from a noisy image without access to the ground truth. State-of-the-art solutions for this task rely on predicting masked pixels with a fully-convolutional neural network. This most often requires multiple forward passes, information about the noise model, or intricate regularization functions. In this paper, we propose a Swin Transformer-based Image Autoencoder (SwinIA), the first fully-transformer architecture for self-supervised denoising. The flexibility of the attention mechanism helps to fulfill the blind-spot property that convolutional counterparts normally approximate. SwinIA can be trained end-to-end with a simple mean squared error loss without masking and does not require any prior knowledge about clean data or noise distribution. Simple to use, SwinIA establishes the state of the art on several common benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Color Image DenoisingDenoisingGrayscale Image DenoisingImage DenoisingMedical Image DenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pseudo-Siamese Blind-Spot Transformers for Self-Supervised Real-World Denoising
Real-world image denoising remains a challenge task. This paper studies self-supervised image denoising, requiring only noisy images captured in a single shot. We revamping the blind-spot technique by leveraging the tran…
DenoisingImage DenoisingBlind2Unblind: Self-Supervised Image Denoising with Visible Blind Spots
Real noisy-clean pairs on a large scale are costly and difficult to obtain. Meanwhile, supervised denoisers trained on synthetic data perform poorly in practice. Self-supervised denoisers, which learn only from single no…
DenoisingImage DenoisingView Blind-spot as Inpainting: Self-Supervised Denoising with Mask Guided Residual Convolution
In recent years, self-supervised denoising methods have shown impressive performance, which circumvent painstaking collection procedure of noisy-clean image pairs in supervised denoising methods and boost denoising appli…
DenoisingRethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising
Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID). However, most existing BSNs are conducted with convolution layers. Although transformers have shown the potent…
Computational EfficiencyDenoisingImage DenoisingImage Restoration+1Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot Network
There have been many image denoisers using deep neural networks, which outperform conventional model-based methods by large margins. Recently, self-supervised methods have attracted attention because constructing a large…
DenoisingImage Denoising