Compact Representation for Image Classification: To Choose or to Compress?
In large scale image classification, features such as Fisher vector or VLAD have achieved state-of-the-art results. However, the combination of large number of examples and high dimensional vectors necessitates dimensionality reduction, in order to reduce its storage and CPU costs to a reasonable range. In spite of the popularity of various feature compression methods, this paper argues that feature selection is a better choice than feature compression. We show that strong multicollinearity among feature dimensions may not exist, which undermines feature compression's effectiveness and renders feature selection a natural choice. We also show that many dimensions are noise and throwing them away is helpful for classification. We propose a supervised mutual information (MI) based importance sorting algorithm to choose features. Combining with 1-bit quantization, MI feature selection has achieved both higher accuracy and less computational cost than feature compression methods such as product quantization and BPBC.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationCPUDimensionality ReductionFeature Compressionfeature selectionGeneral Classificationimage-classificationImage ClassificationQuantizationSimilar Papers 제목 키워드 기반
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression
This paper investigates deep neural network (DNN) compression from the perspective of compactly representing and storing trained parameters. We explore the previously overlooked opportunity of cross-layer architecture-ag…
Neural Network CompressionQuantizationImage Similarity Using Sparse Representation and Compression Distance
A new line of research uses compression methods to measure the similarity between signals. Two signals are considered similar if one can be compressed significantly when the information of the other is known. The existin…
ClusteringImage ClusteringRetrievalHow Compact?: Assessing Compactness of Representations through Layer-Wise Pruning
Various forms of representations may arise in the many layers embedded in deep neural networks (DNNs). Of these, where can we find the most compact representation? We propose to use a pruning framework to answer this que…
image-classificationImage ClassificationEnhanced Standard Compatible Image Compression Framework based on Auxiliary Codec Networks
To enhance image compression performance, recent deep neural network-based research can be divided into three categories: a learnable codec, a postprocessing network, and a compact representation network. The learnable c…
Image CompressionA Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation
Recently, DNN model compression based on network architecture design, e.g., SqueezeNet, attracted a lot attention. No accuracy drop on image classification is observed on these extremely compact networks, compared to wel…
ClassificationDomain AdaptationGeneral Classificationimage-classification+2