paper-with-me

홈 › Papers

EWT: Efficient Wavelet-Transformer for Single Image Denoising

2023-04-13 · Juncheng Li, Bodong Cheng, Ying Chen, Guangwei Gao, Tieyong Zeng

Transformer-based image denoising methods have achieved encouraging results in the past year. However, it must uses linear operations to model long-range dependencies, which greatly increases model inference time and consumes GPU storage space. Compared with convolutional neural network-based methods, current Transformer-based image denoising methods cannot achieve a balance between performance improvement and resource consumption. In this paper, we propose an Efficient Wavelet Transformer (EWT) for image denoising. Specifically, we use Discrete Wavelet Transform (DWT) and Inverse Wavelet Transform (IWT) for downsampling and upsampling, respectively. This method can fully preserve the image features while reducing the image resolution, thereby greatly reducing the device resource consumption of the Transformer model. Furthermore, we propose a novel Dual-stream Feature Extraction Block (DFEB) to extract image features at different levels, which can further reduce model inference time and GPU memory usage. Experiments show that our method speeds up the original Transformer by more than 80%, reduces GPU memory usage by more than 60%, and achieves excellent denoising results. All code will be public.

📄 PDF Abstract BibTeX arXiv:2304.06274

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingGPUImage Denoising

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

2022-07-28 · Hao Li, Zhijing Yang, Xiaobin Hong, Ziying Zhao 외

Real-world image denoising is a practical image restoration problem that aims to obtain clean images from in-the-wild noisy inputs. Recently, the Vision Transformer (ViT) has exhibited a strong ability to capture long-ra…

DecoderDenoisingImage DenoisingImage Restoration

Single image super resolution in spatial and wavelet domain

2013-09-09 · Sapan Naik, Nikunj Patel

Recently single image super resolution is very important research area to generate high resolution image from given low resolution image. Algorithms of single image resolution are mainly based on wavelet domain and spati…

DenoisingImage Super-ResolutionSuper-Resolution

Restoring Snow-Degraded Single Images With Wavelet in Vision Transformer

2023-09-11 · IEEE Access 2023 9 · Obinna Agbodike, Jenhui Chen

Images corrupted by snowy adverse weather can impose performance impediments to critical high-level vision-based applications. Restoring snow-degraded images is vital, but the task is ill-posed and very challenging due t…

Deep AttentionDenoisingImage DenoisingSnow Removal

Progressive Training of Multi-level Wavelet Residual Networks for Image Denoising

2020-10-23 · Yali Peng, Yue Cao, Shigang Liu, Jian Yang 외

Recent years have witnessed the great success of deep convolutional neural networks (CNNs) in image denoising. Albeit deeper network and larger model capacity generally benefit performance, it remains a challenging pract…

DenoisingImage Denoising

Trans-defense: Transformer-based Denoiser for Adversarial Defense with Spatial-Frequency Domain Representation

2025-10-31 · Alik Pramanick, Mayank Bansal, Utkarsh Srivastava, Suklav Ghosh 외 arxiv

In recent times, deep neural networks (DNNs) have been successfully adopted for various applications. Despite their notable achievements, it has become evident that DNNs are vulnerable to sophisticated adversarial attack…

Adversarial Defense