Deep FisherNet for Object Classification
Despite the great success of convolutional neural networks (CNN) for the image classification task on datasets like Cifar and ImageNet, CNN's representation power is still somewhat limited in dealing with object images that have large variation in size and clutter, where Fisher Vector (FV) has shown to be an effective encoding strategy. FV encodes an image by aggregating local descriptors with a universal generative Gaussian Mixture Model (GMM). FV however has limited learning capability and its parameters are mostly fixed after constructing the codebook. To combine together the best of the two worlds, we propose in this paper a neural network structure with FV layer being part of an end-to-end trainable system that is differentiable; we name our network FisherNet that is learnable using backpropagation. Our proposed FisherNet combines convolutional neural network training and Fisher Vector encoding in a single end-to-end structure. We observe a clear advantage of FisherNet over plain CNN and standard FV in terms of both classification accuracy and computational efficiency on the challenging PASCAL VOC object classification task.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationComputational EfficiencyGeneral Classificationimage-classificationImage ClassificationObjectSimilar Papers 제목 키워드 기반
Probabilistic Autoencoder using Fisher Information
Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set …
DecoderPositionUncertainty QuantificationRevisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data
Deep learning techniques for point cloud data have demonstrated great potentials in solving classical problems in 3D computer vision such as 3D object classification and segmentation. Several recent 3D object classificat…
3D Object Classification3D Point Cloud ClassificationClassificationGeneral Classification+2Quantum Tensor Network in Machine Learning: An Application to Tiny Object Classification
Tiny object classification problem exists in many machine learning applications like medical imaging or remote sensing, where the object of interest usually occupies a small region of the whole image. It is challenging t…
BIG-bench Machine LearningClassificationGeneral Classificationimage-classification+3Learning Class-to-Image Distance with Object Matchings
We conduct image classification by learning a class-toimage distance function that matches objects. The set of objects in training images for an image class are treated as a collage. When presented with a test image, the…
ClassificationGeneral Classificationimage-classificationImage Classification+2A Classification Leveraged Object Detector
Currently, the state-of-the-art image classification algorithms outperform the best available object detector by a big margin in terms of average precision. We, therefore, propose a simple yet principled approach that al…
ClassificationGeneral Classificationimage-classificationImage Classification+3