Power Normalizations in Fine-grained Image, Few-shot Image and Graph Classification
Power Normalizations (PN) are useful non-linear operators which tackle feature imbalances in classification problems. We study PNs in the deep learning setup via a novel PN layer pooling feature maps. Our layer combines the feature vectors and their respective spatial locations in the feature maps produced by the last convolutional layer of CNN into a positive definite matrix with second-order statistics to which PN operators are applied, forming so-called Second-order Pooling (SOP). As the main goal of this paper is to study Power Normalizations, we investigate the role and meaning of MaxExp and Gamma, two popular PN functions. To this end, we provide probabilistic interpretations of such element-wise operators and discover surrogates with well-behaved derivatives for end-to-end training. Furthermore, we look at the spectral applicability of MaxExp and Gamma by studying Spectral Power Normalizations (SPN). We show that SPN on the autocorrelation/covariance matrix and the Heat Diffusion Process (HDP) on a graph Laplacian matrix are closely related, thus sharing their properties. Such a finding leads us to the culmination of our work, a fast spectral MaxExp which is a variant of HDP for covariances/autocorrelation matrices. We evaluate our ideas on fine-grained recognition, scene recognition, and material classification, as well as in few-shot learning and graph classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningGeneral ClassificationGraph ClassificationMaterial ClassificationScene RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Power Normalizing Second-order Similarity Network for Few-shot Learning
Second- and higher-order statistics of data points have played an important role in advancing the state of the art on several computer vision problems such as the fine-grained image and scene recognition. However, these …
Few-Shot LearningScene RecognitionA Deeper Look at Power Normalizations
Power Normalizations (PN) are very useful non-linear operators in the context of Bag-of-Words data representations as they tackle problems such as feature imbalance. In this paper, we reconsider these operators in the de…
Material ClassificationScene RecognitionEfficient Action Localization with Approximately Normalized Fisher Vectors
The Fisher vector (FV) representation is a high-dimensional extension of the popular bag-of-word representation. Transformation of the FV by power and L2 normalizations has shown to significantly improve its performance,…
Action LocalizationAction RecognitionGeneral ClassificationRetrieval+3Dual Attention Networks for Few-Shot Fine-Grained Recognition
The task of few-shot fine-grained recognition is to classify images belonging to subordinate categories merely depending on few examples. Due to the fine-grained nature, it is desirable to capture subtle but discriminati…
Hard AttentionMeta-LearningMeta-Reinforced Synthetic Data for One-Shot Fine-Grained Visual Recognition
One-shot fine-grained visual recognition often suffers from the problem of training data scarcity for new fine-grained classes. To alleviate this problem, an off-the-shelf image generator can be applied to synthesize add…
Fine-Grained Image ClassificationFine-Grained Visual Recognitionimage-classificationImage Classification+2