paper-with-me

홈 › Papers

Structural Compression of Convolutional Neural Networks

2017-05-20 · Reza Abbasi-Asl, Bin Yu

Deep convolutional neural networks (CNNs) have been successful in many tasks in machine vision, however, millions of weights in the form of thousands of convolutional filters in CNNs makes them difficult for human intepretation or understanding in science. In this article, we introduce CAR, a greedy structural compression scheme to obtain smaller and more interpretable CNNs, while achieving close to original accuracy. The compression is based on pruning filters with the least contribution to the classification accuracy. We demonstrate the interpretability of CAR-compressed CNNs by showing that our algorithm prunes filters with visually redundant functionalities such as color filters. These compressed networks are easier to interpret because they retain the filter diversity of uncompressed networks with order of magnitude less filters. Finally, a variant of CAR is introduced to quantify the importance of each image category to each CNN filter. Specifically, the most and the least important class labels are shown to be meaningful interpretations of each filter.

📄 PDF Abstract BibTeX arXiv:1705.07356

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityGeneral Classification

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Interpretability 설명 없음

Similar Papers 제목 키워드 기반

An End-to-End Compression Framework Based on Convolutional Neural Networks

2017-08-02 · Feng Jiang, Wen Tao, Shaohui Liu, Jie Ren 외

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, i…

DenoisingImage Compression

X-Ray Image Compression Using Convolutional Recurrent Neural Networks

2019-04-28 · Asif Shahriyar Sushmit, Shakib Uz Zaman, Ahmed Imtiaz Humayun, Taufiq Hasan 외

In the advent of a digital health revolution, vast amounts of clinical data are being generated, stored and processed on a daily basis. This has made the storage and retrieval of large volumes of health-care data, especi…

Image CompressionRetrievalSSIMX-Ray Image Compression

Fully Convolutional Model for Variable Bit Length and Lossy High Density Compression of Mammograms

2018-05-17 · Aupendu Kar, Sri Phani Krishna Karri, Nirmalya Ghosh, Ramanathan Sethuraman 외

Early works on medical image compression date to the 1980's with the impetus on deployment of teleradiology systems for high-resolution digital X-ray detectors. Commercially deployed systems during the period could compr…

Image CompressionSSIM

Convolutional Neural Network Pruning with Structural Redundancy Reduction

2021-04-08 · CVPR 2021 1 · Zi Wang, Chengcheng Li, Xiangyang Wang

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in …

Network Pruning

Learning Convolutional Networks for Content-weighted Image Compression

2017-03-30 · CVPR 2018 6 · Mu Li, WangMeng Zuo, Shuhang Gu, Debin Zhao 외

Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is r…

BinarizationDecoderImage CompressionSSIM