Filter Pruning by Switching to Neighboring CNNs with Good Attributes

2019-04-08 · Yang He, Ping Liu, Linchao Zhu, Yi Yang

Filter pruning is effective to reduce the computational costs of neural networks. Existing methods show that updating the previous pruned filter would enable large model capacity and achieve better performance. However, during the iterative pruning process, even if the network weights are updated to new values, the pruning criterion remains the same. In addition, when evaluating the filter importance, only the magnitude information of the filters is considered. However, in neural networks, filters do not work individually, but they would affect other filters. As a result, the magnitude information of each filter, which merely reflects the information of an individual filter itself, is not enough to judge the filter importance. To solve the above problems, we propose Meta-attribute-based Filter Pruning (MFP). First, to expand the existing magnitude information based pruning criteria, we introduce a new set of criteria to consider the geometric distance of filters. Additionally, to explicitly assess the current state of the network, we adaptively select the most suitable criteria for pruning via a meta-attribute, a property of the neural network at the current state. Experiments on two image classification benchmarks validate our method. For ResNet-50 on ILSVRC-2012, we could reduce more than 50% FLOPs with only 0.44% top-5 accuracy loss.

📄 PDF Abstract BibTeX arXiv:1904.03961

Code (0)

등록된 구현이 없습니다.

Tasks

Attributeimage-classification Image Classification

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Efficient CNNs via Passive Filter Pruning

2023-04-05 · Arshdeep Singh, Mark D. Plumbley

Convolutional neural networks (CNNs) have shown state-of-the-art performance in various applications. However, CNNs are resource-hungry due to their requirement of high computational complexity and memory storage. Recent…

Computational Efficiency image-classification Image Classification Scene Classification

EXPLAINABLE AI-BASED DYNAMIC FILTER PRUNING OF CONVOLUTIONAL NEURAL NETWORKS

2021-09-29 · Muhammad Sabih, Frank Hannig, Jürgen Teich

Filter pruning is one of the most effective ways to accelerate Convolutional Neural Networks (CNNs). Most of the existing works are focused on the static pruning of CNN filters. In dynamic pruning of CNN filters, existin…

CPU GPU image-classification Image Classification

CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics

2020-09-08 · Guan Li, Junpeng Wang, Han-Wei Shen, Kaixin Chen 외

Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with …

Efficient Similarity-based Passive Filter Pruning for Compressing CNNs

2022-10-27 · Arshdeep Singh, Mark D. Plumbley

Convolution neural networks (CNNs) have shown great success in various applications. However, the computational complexity and memory storage of CNNs is a bottleneck for their deployment on resource-constrained devices. …

Acoustic Scene Classification Scene Classification

Interspace Pruning: Using Adaptive Filter Representations to Improve Training of Sparse CNNs

2022-03-15 · CVPR 2022 1 · Paul Wimmer, Jens Mehnert, Alexandru Paul Condurache

Unstructured pruning is well suited to reduce the memory footprint of convolutional neural networks (CNNs), both at training and inference time. CNNs contain parameters arranged in $K \times K$ filters. Standard unstruct…