paper-with-me

홈 › Papers

Wavelet-Attention CNN for Image Classification

2022-01-23 · Zhao Xiangyu

The feature learning methods based on convolutional neural network (CNN) have successfully produced tremendous achievements in image classification tasks. However, the inherent noise and some other factors may weaken the effectiveness of the convolutional feature statistics. In this paper, we investigate Discrete Wavelet Transform (DWT) in the frequency domain and design a new Wavelet-Attention (WA) block to only implement attention in the high-frequency domain. Based on this, we propose a Wavelet-Attention convolutional neural network (WA-CNN) for image classification. Specifically, WA-CNN decomposes the feature maps into low-frequency and high-frequency components for storing the structures of the basic objects, as well as the detailed information and noise, respectively. Then, the WA block is leveraged to capture the detailed information in the high-frequency domain with different attention factors but reserves the basic object structures in the low-frequency domain. Experimental results on CIFAR-10 and CIFAR-100 datasets show that our proposed WA-CNN achieves significant improvements in classification accuracy compared to other related networks. Specifically, based on MobileNetV2 backbones, WA-CNN achieves 1.26% Top-1 accuracy improvement on the CIFAR-10 benchmark and 1.54% Top-1 accuracy improvement on the CIFAR-100 benchmark.

📄 PDF Abstract BibTeX arXiv:2201.09271

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Batch Normalization 설명 없음
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Inverted Residual Block 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

WaveNets: Wavelet Channel Attention Networks

2022-11-04 · Hadi Salman, Caleb Parks, Shi Yin Hong, Justin Zhan

Channel Attention reigns supreme as an effective technique in the field of computer vision. However, the proposed channel attention by SENet suffers from information loss in feature learning caused by the use of Global A…

image-classificationImage Classification

Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification

2024-03-27 · Qingyu Wang, Duzhen Zhang, Tilelin Zhang, Bo Xu

Energy-efficient spikformer has been proposed by integrating the biologically plausible spiking neural network (SNN) and artificial Transformer, whereby the Spiking Self-Attention (SSA) is used to achieve both higher acc…

FormGPU

Multiscale Attention via Wavelet Neural Operators for Vision Transformers

2023-03-22 · Anahita Nekoozadeh, Mohammad Reza Ahmadzadeh, Zahra Mardani

Transformers have achieved widespread success in computer vision. At their heart, there is a Self-Attention (SA) mechanism, an inductive bias that associates each token in the input with every other token through a weigh…

Inductive BiasOperator learning

Wavelet-based Bi-dimensional Aggregation Network for SAR Image Change Detection

2024-07-18 · Jiangwei Xie, Feng Gao, Xiaowei Zhou, Junyu Dong

Synthetic aperture radar (SAR) image change detection is critical in remote sensing image analysis. Recently, the attention mechanism has been widely used in change detection tasks. However, existing attention mechanisms…

Change DetectionComputational Efficiency

Wavelet Channel Attention Module with a Fusion Network for Single Image Deraining

2020-07-17 · Hao-Hsiang Yang, Chao-Han Huck Yang, Yu-Chiang Frank Wang

Single image deraining is a crucial problem because rain severely degenerates the visibility of images and affects the performance of computer vision tasks like outdoor surveillance systems and intelligent vehicles. In t…

Rain RemovalSingle Image Deraining