Structural Compression of Convolutional Neural Networks
Deep convolutional neural networks (CNNs) have been successful in many tasks in machine vision, however, millions of weights in the form of thousands of convolutional filters in CNNs makes them difficult for human intepretation or understanding in science. In this article, we introduce CAR, a greedy structural compression scheme to obtain smaller and more interpretable CNNs, while achieving close to original accuracy. The compression is based on pruning filters with the least contribution to the classification accuracy. We demonstrate the interpretability of CAR-compressed CNNs by showing that our algorithm prunes filters with visually redundant functionalities such as color filters. These compressed networks are easier to interpret because they retain the filter diversity of uncompressed networks with order of magnitude less filters. Finally, a variant of CAR is introduced to quantify the importance of each image category to each CNN filter. Specifically, the most and the least important class labels are shown to be meaningful interpretations of each filter.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityGeneral ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An End-to-End Compression Framework Based on Convolutional Neural Networks
Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, i…
DenoisingImage CompressionX-Ray Image Compression Using Convolutional Recurrent Neural Networks
In the advent of a digital health revolution, vast amounts of clinical data are being generated, stored and processed on a daily basis. This has made the storage and retrieval of large volumes of health-care data, especi…
Image CompressionRetrievalSSIMX-Ray Image CompressionFully Convolutional Model for Variable Bit Length and Lossy High Density Compression of Mammograms
Early works on medical image compression date to the 1980's with the impetus on deployment of teleradiology systems for high-resolution digital X-ray detectors. Commercially deployed systems during the period could compr…
Image CompressionSSIMConvolutional Neural Network Pruning with Structural Redundancy Reduction
Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in …
Network PruningLearning Convolutional Networks for Content-weighted Image Compression
Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is r…
BinarizationDecoderImage CompressionSSIM