DFT-based Transformation Invariant Pooling Layer for Visual Classification
We propose a novel discrete Fourier transform-based pooling layer for convolutional neural networks. The DFT magnitude pooling replaces the traditional max/average pooling layer between the convolution and fully-connected layers to retain translation invariance and shape preserving (aware of shape difference) properties based on the shift theorem of the Fourier transform. Thanks to the ability to handle image misalignment while keeping important structural information in the pooling stage, the DFT magnitude pooling improves the classification accuracy significantly. In addition, we propose the DFT+ method for ensemble networks using the middle convolution layer outputs. The proposed methods are extensively evaluated on various classification tasks using the ImageNet, CUB 2010-2011, MIT Indoors, Caltech 101, FMD and DTD datasets. The AlexNet, VGG-VD 16, Inception-v3, and ResNet are used as the base networks, upon which DFT and DFT+ methods are implemented. Experimental results show that the proposed methods improve the classification performance in all networks and datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graph-based Isometry Invariant Representation Learning
Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. Howe…
General ClassificationRepresentation LearningTranslationVideo ClassificationIsometric Transformation Invariant Graph-based Deep Neural Network
Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. Howe…
General ClassificationTranslationVideo ClassificationA Deep Representation for Invariance And Music Classification
Representations in the auditory cortex might be based on mechanisms similar to the visual ventral stream; modules for building invariance to transformations and multiple layers for compositionality and selectivity. In th…
ClassificationGeneral ClassificationGenre classificationMusic Classification+1GIFT: Learning Transformation-Invariant Dense Visual Descriptors via Group CNNs
Finding local correspondences between images with different viewpoints requires local descriptors that are robust against geometric transformations. An approach for transformation invariance is to integrate out the trans…
Pose EstimationLearning Invariant Representations for Equivariant Neural Networks Using Orthogonal Moments
The convolutional layers of standard convolutional neural networks (CNNs) are equivariant to translation. However, the convolution and fully-connected layers are not equivariant or invariant to other affine geometric tra…
Rotated MNISTTranslation