Analyzing the Dependency of ConvNets on Spatial Information
Intuitively, image classification should profit from using spatial information. Recent work, however, suggests that this might be overrated in standard CNNs. In this paper, we are pushing the envelope and aim to further investigate the reliance on spatial information. We propose spatial shuffling and GAP+FC to destroy spatial information during both training and testing phases. Interestingly, we observe that spatial information can be deleted from later layers with small performance drops, which indicates spatial information at later layers is not necessary for good performance. For example, test accuracy of VGG-16 only drops by 0.03% and 2.66% with spatial information completely removed from the last 30% and 53% layers on CIFAR100, respectively. Evaluation on several object recognition datasets (CIFAR100, Small-ImageNet, ImageNet) with a wide range of CNN architectures (VGG16, ResNet50, ResNet152) shows an overall consistent pattern.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationObject RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimization Planning for 3D ConvNets
It is not trivial to optimally learn a 3D Convolutional Neural Networks (3D ConvNets) due to high complexity and various options of the training scheme. The most common hand-tuning process starts from learning 3D ConvNet…
Video RecognitionInitialization Strategies of Spatio-Temporal Convolutional Neural Networks
We propose a new way of incorporating temporal information present in videos into Spatial Convolutional Neural Networks (ConvNets) trained on images, that avoids training Spatio-Temporal ConvNets from scratch. We describ…
Analyzing Filters Toward Efficient ConvNet
Deep convolutional neural network (ConvNet) is a promising approach for high-performance image classification. The behavior of ConvNet is analyzed mainly based on the neuron activations, such as by visualizing them. In t…
ClassificationGeneral Classificationimage-classificationImage ClassificationPooling the Convolutional Layers in Deep ConvNets for Action Recognition
Deep ConvNets have shown its good performance in image classification tasks. However it still remains as a problem in deep video representation for action recognition. The problem comes from two aspects: on one hand, cur…
Action Recognitionimage-classificationImage ClassificationTemporal Action LocalizationDeep Learning with ConvNET Predicts Imagery Tasks Through EEG
Deep learning with convolutional neural networks (ConvNets) have dramatically improved learning capabilities of computer vision applications just through considering raw data without any prior feature extraction. Nowaday…
BIG-bench Machine LearningDeep LearningEEGElectroencephalogram (EEG)