paper-with-me

홈 › Papers

Stochastic Region Pooling: Make Attention More Expressive

2019-04-22 · Mingnan Luo, Guihua Wen, Yang Hu, Dan Dai, Yingxue Xu

Global Average Pooling (GAP) is used by default on the channel-wise attention mechanism to extract channel descriptors. However, the simple global aggregation method of GAP is easy to make the channel descriptors have homogeneity, which weakens the detail distinction between feature maps, thus affecting the performance of the attention mechanism. In this work, we propose a novel method for channel-wise attention network, called Stochastic Region Pooling (SRP), which makes the channel descriptors more representative and diversity by encouraging the feature map to have more or wider important feature responses. Also, SRP is the general method for the attention mechanisms without any additional parameters or computation. It can be widely applied to attention networks without modifying the network structure. Experimental results on image recognition datasets including CIAFR-10/100, ImageNet and three Fine-grained datasets (CUB-200-2011, Stanford Cars and Stanford Dogs) show that SRP brings the significant improvements of the performance over efficient CNNs and achieves the state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:1904.09853

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음

Similar Papers 제목 키워드 기반

Stochastic Pooling for Regularization of Deep Convolutional Neural Networks

2013-01-16 · Matthew D. Zeiler, Rob Fergus

We introduce a simple and effective method for regularizing large convolutional neural networks. We replace the conventional deterministic pooling operations with a stochastic procedure, randomly picking the activation w…

Data AugmentationImage Classification

FoveaTer: Foveated Transformer for Image Classification

2021-05-29 · Aditya Jonnalagadda, William Yang Wang, B. S. Manjunath, Miguel P. Eckstein

Many animals and humans process the visual field with a varying spatial resolution (foveated vision) and use peripheral processing to make eye movements and point the fovea to acquire high-resolution information about ob…

Classificationimage-classificationImage Classification

DropRegion Training of Inception Font Network for High-Performance Chinese Font Recognition

2017-03-17 · Shuangping Huangm Zhuoyao Zhong, Lianwen Jin, Shuye Zhang, Haobin Wang

Chinese font recognition (CFR) has gained significant attention in recent years. However, due to the sparsity of labeled font samples and the structural complexity of Chinese characters, CFR is still a challenging task. …

Font Recognition

Fractional Max-Pooling

2014-12-18 · Benjamin Graham

Convolutional networks almost always incorporate some form of spatial pooling, and very often it is alpha times alpha max-pooling with alpha=2. Max-pooling act on the hidden layers of the network, reducing their size by …

Image Classification

PVAFN: Point-Voxel Attention Fusion Network with Multi-Pooling Enhancing for 3D Object Detection

2024-08-26 · Yidi Li, Jiahao Wen, Bin Ren, Wenhao Li 외

The integration of point and voxel representations is becoming more common in LiDAR-based 3D object detection. However, this combination often struggles with capturing semantic information effectively. Moreover, relying …

3D Object DetectionObjectobject-detectionObject Detection