paper-with-me

홈 › Papers

Compact Representation for Image Classification: To Choose or to Compress?

2014-06-01 · CVPR 2014 6 · Yu Zhang, Jianxin Wu, Jianfei Cai

In large scale image classification, features such as Fisher vector or VLAD have achieved state-of-the-art results. However, the combination of large number of examples and high dimensional vectors necessitates dimensionality reduction, in order to reduce its storage and CPU costs to a reasonable range. In spite of the popularity of various feature compression methods, this paper argues that feature selection is a better choice than feature compression. We show that strong multicollinearity among feature dimensions may not exist, which undermines feature compression's effectiveness and renders feature selection a natural choice. We also show that many dimensions are noise and throwing them away is helpful for classification. We propose a supervised mutual information (MI) based importance sorting algorithm to choose features. Combining with 1-bit quantization, MI feature selection has achieved both higher accuracy and less computational cost than feature compression methods such as product quantization and BPBC.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationCPUDimensionality ReductionFeature Compressionfeature selectionGeneral Classificationimage-classificationImage ClassificationQuantization

Similar Papers 제목 키워드 기반

Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression

2021-11-19 · Yuezhou Sun, Wenlong Zhao, Lijun Zhang, Xiao Liu 외

This paper investigates deep neural network (DNN) compression from the perspective of compactly representing and storing trained parameters. We explore the previously overlooked opportunity of cross-layer architecture-ag…

Neural Network CompressionQuantization

Image Similarity Using Sparse Representation and Compression Distance

2012-06-12 · Tanaya Guha, Rabab K. Ward

A new line of research uses compression methods to measure the similarity between signals. Two signals are considered similar if one can be compressed significantly when the information of the other is known. The existin…

ClusteringImage ClusteringRetrieval

How Compact?: Assessing Compactness of Representations through Layer-Wise Pruning

2019-01-09 · Hyun-Joo Jung, Jaedeok Kim, Yoonsuck Choe

Various forms of representations may arise in the many layers embedded in deep neural networks (DNNs). Of these, where can we find the most compact representation? We propose to use a pruning framework to answer this que…

image-classificationImage Classification

Enhanced Standard Compatible Image Compression Framework based on Auxiliary Codec Networks

2020-09-30 · Hanbin Son, Taeoh Kim, Hyeongmin Lee, Sangyoun Lee

To enhance image compression performance, recent deep neural network-based research can be divided into three categories: a learnable codec, a postprocessing network, and a compact representation network. The learnable c…

Image Compression

A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation

2017-03-12 · CVPR 2017 7 · Chunpeng Wu, Wei Wen, Tariq Afzal, Yongmei Zhang 외

Recently, DNN model compression based on network architecture design, e.g., SqueezeNet, attracted a lot attention. No accuracy drop on image classification is observed on these extremely compact networks, compared to wel…

ClassificationDomain AdaptationGeneral Classificationimage-classification+2