paper-with-me

홈 › Papers

SwinIR: Image Restoration Using Swin Transformer

2021-08-23 · Jingyun Liang, JieZhang Cao, Guolei Sun, Kai Zhang, Luc van Gool, Radu Timofte

Image restoration is a long-standing low-level vision problem that aims to restore high-quality images from low-quality images (e.g., downscaled, noisy and compressed images). While state-of-the-art image restoration methods are based on convolutional neural networks, few attempts have been made with Transformers which show impressive performance on high-level vision tasks. In this paper, we propose a strong baseline model SwinIR for image restoration based on the Swin Transformer. SwinIR consists of three parts: shallow feature extraction, deep feature extraction and high-quality image reconstruction. In particular, the deep feature extraction module is composed of several residual Swin Transformer blocks (RSTB), each of which has several Swin Transformer layers together with a residual connection. We conduct experiments on three representative tasks: image super-resolution (including classical, lightweight and real-world image super-resolution), image denoising (including grayscale and color image denoising) and JPEG compression artifact reduction. Experimental results demonstrate that SwinIR outperforms state-of-the-art methods on different tasks by $\textbf{up to 0.14$\sim$0.45dB}$, while the total number of parameters can be reduced by $\textbf{up to 67%}$.

📄 PDF Abstract BibTeX arXiv:2108.10257

Code (9)

jingyunliang/swinir 공식 구현 pytorch
XPixelGroup/BasicSR pytorch
ayanglab/swinganmr pytorch
ayanglab/swinmr pytorch
jingyunliang/vrt pytorch
mv-lab/swin2sr pytorch
pilot7747/sldl pytorch
rami0205/ngramswin pytorch
skchen1993/SwinIR pytorch

Tasks

Color Image DenoisingDenoisingGrayscale Image DenoisingImage DenoisingImage ReconstructionImage RestorationImage Super-ResolutionJpeg Compression Artifact ReductionSuper-ResolutionVideo Super-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Content-Aware Transformer for All-in-one Image Restoration

2025-04-07 · Gang Wu, Junjun Jiang, Kui Jiang, Xianming Liu

Image restoration has witnessed significant advancements with the development of deep learning models. Although Transformer architectures have progressed considerably in recent years, challenges remain, particularly the …

AllImage RestorationRain Removal

Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restoration

2022-09-22 · Marcos V. Conde, Ui-Jin Choi, Maxime Burchi, Radu Timofte

Compression plays an important role on the efficient transmission and storage of images and videos through band-limited systems such as streaming services, virtual reality or videogames. However, compression unavoidably …

Compressed Image Super-resolutionImage RestorationImage Super-ResolutionJPEG Artifact Correction+1

Residual Swin Transformer Channel Attention Network for Image Demosaicing

2022-04-14 · Wenzhu Xing, Karen Egiazarian

Image demosaicing is problem of interpolating full- resolution color images from raw sensor (color filter array) data. During last decade, deep neural networks have been widely used in image restoration, and in particula…

DemosaickingImage Restoration

Resolution Enhancement Processing on Low Quality Images Using Swin Transformer Based on Interval Dense Connection Strategy

2023-03-16 · Rui-Yang Ju, Chih-Chia Chen, Jen-Shiun Chiang, Yu-Shian Lin 외

The Transformer-based method has demonstrated remarkable performance for image super-resolution in comparison to the method based on the convolutional neural networks (CNNs). However, using the self-attention mechanism l…

Image CroppingImage RestorationImage Super-Resolutionobject-detection+3

SwinFSR: Stereo Image Super-Resolution using SwinIR and Frequency Domain Knowledge

2023-04-25 · Ke Chen, Liangyan Li, Huan Liu, Yunzhe Li 외

Stereo Image Super-Resolution (stereoSR) has attracted significant attention in recent years due to the extensive deployment of dual cameras in mobile phones, autonomous vehicles and robots. In this work, we propose a ne…

Autonomous VehiclesImage RestorationImage Super-ResolutionStereo Image Super-Resolution+1