paper-with-me

홈 › Papers

SNF: Filter Pruning via Searching the Proper Number of Filters

2021-12-14 · Pengkun Liu, Yaru Yue, Yanjun Guo, Xingxiang Tao, Xiaoguang Zhou

Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more attention to designing evaluation criteria of filter importance and then prune less important filters with a fixed pruning rate or a fixed number to reduce convolutional neural networks' redundancy. It does not consider how many filters to reserve for each layer is the most reasonable choice. From this perspective, we propose a new filter pruning method by searching the proper number of filters (SNF). SNF is dedicated to searching for the most reasonable number of reserved filters for each layer and then pruning filters with specific criteria. It can tailor the most suitable network structure at different FLOPs. Filter pruning with our method leads to the state-of-the-art (SOTA) accuracy on CIFAR-10 and achieves competitive performance on ImageNet ILSVRC-2012.SNF based on the ResNet-56 network achieves an increase of 0.14% in Top-1 accuracy at 52.94% FLOPs reduction on CIFAR-10. Pruning ResNet-110 on CIFAR-10 also improves the Top-1 accuracy of 0.03% when reducing 68.68% FLOPs. For ImageNet, we set the pruning rates as 52.10% FLOPs, and the Top-1 accuracy only has a drop of 0.74%. The codes can be available at https://github.com/pk-l/SNF.

📄 PDF Abstract BibTeX arXiv:2112.07282

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Approximated Oracle Filter Pruning for Destructive CNN Width Optimization

2019-05-12 · Xiaohan Ding, Guiguang Ding, Yuchen Guo, Jungong Han 외

It is not easy to design and run Convolutional Neural Networks (CNNs) due to: 1) finding the optimal number of filters (i.e., the width) at each layer is tricky, given an architecture; and 2) the computational intensity …

Multiple-Hypothesis Affine Region Estimation With Anisotropic LoG Filters

2015-12-01 · ICCV 2015 12 · Takahiro Hasegawa, Mitsuru Ambai, Kohta Ishikawa, Gou Koutaki 외

We propose a method for estimating multiple-hypothesis affine regions from a keypoint by using an anisotropic Laplacian-of-Gaussian (LoG) filter. Although conventional affine region detectors, such as Hessian/Harris-Affi…

Efficient CNNs via Passive Filter Pruning

2023-04-05 · Arshdeep Singh, Mark D. Plumbley

Convolutional neural networks (CNNs) have shown state-of-the-art performance in various applications. However, CNNs are resource-hungry due to their requirement of high computational complexity and memory storage. Recent…

Computational Efficiencyimage-classificationImage ClassificationScene Classification

Investigating Channel Pruning through Structural Redundancy Reduction -- A Statistical Study

2019-05-16 · Chengcheng Li, Zi Wang, Dali Wang, Xiangyang Wang 외

Most existing channel pruning methods formulate the pruning task from a perspective of inefficiency reduction which iteratively rank and remove the least important filters, or find the set of filters that minimizes some …

Sub-network Multi-objective Evolutionary Algorithm for Filter Pruning

2022-10-22 · Xuhua Li, Weize Sun, Lei Huang, Shaowu Chen

Filter pruning is a common method to achieve model compression and acceleration in deep neural networks (DNNs).Some research regarded filter pruning as a combinatorial optimization problem and thus used evolutionary algo…

Combinatorial OptimizationEvolutionary AlgorithmsModel Compression