Transform-Invariant Convolutional Neural Networks for Image Classification and Search
Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with sufficient layers and parameters, hierarchical combinations of convolution (matrix multiplication and non-linear activation) and pooling operations should be able to learn a robust mapping from transformed input images to transform-invariant representations. In this paper, we propose randomly transforming (rotation, scale, and translation) feature maps of CNNs during the training stage. This prevents complex dependencies of specific rotation, scale, and translation levels of training images in CNN models. Rather, each convolutional kernel learns to detect a feature that is generally helpful for producing the transform-invariant answer given the combinatorially large variety of transform levels of its input feature maps. In this way, we do not require any extra training supervision or modification to the optimization process and training images. We show that random transformation provides significant improvements of CNNs on many benchmark tasks, including small-scale image recognition, large-scale image recognition, and image retrieval. The code is available at https://github.com/jasonustc/caffe-multigpu/tree/TICNN.
Code (1)
Tasks
ClassificationGeneral Classificationimage-classificationImage ClassificationImage RetrievalRetrievalTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Invariant Scattering Transform for Medical Imaging
Invariant scattering transform introduces new area of research that merges the signal processing with deep learning for computer vision. Nowadays, Deep Learning algorithms are able to solve a variety of problems in medic…
Decision MakingDeep Learningimage-classificationImage Classification+2Invariant Scattering Transform for Medical Imaging
Over the years, the Invariant Scattering Transform (IST) technique has become popular for medical image analysis, including using wavelet transform computation using Convolutional Neural Networks (CNN) to capture pattern…
Medical Image AnalysisStudying Invariances of Trained Convolutional Neural Networks
Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learn…
General Classificationimage-classificationImage ClassificationRotation-Invariant Autoencoders for Signals on Spheres
Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of…
ClusteringRetrievalGenerating Binary Tags for Fast Medical Image Retrieval Based on Convolutional Nets and Radon Transform
Content-based image retrieval (CBIR) in large medical image archives is a challenging and necessary task. Generally, different feature extraction methods are used to assign expressive and invariant features to each image…
Content-Based Image RetrievalGeneral ClassificationImage RetrievalMedical Image Retrieval+1