paper-with-me

Papers

Sub-network Multi-objective Evolutionary Algorithm for Filter Pruning

2022-10-22 · Xuhua Li, Weize Sun, Lei Huang, Shaowu Chen

Filter pruning is a common method to achieve model compression and acceleration in deep neural networks (DNNs).Some research regarded filter pruning as a combinatorial optimization problem and thus used evolutionary algorithms (EA) to prune filters of DNNs. However, it is difficult to find a satisfactory compromise solution in a reasonable time due to the complexity of solution space searching. To solve this problem, we first formulate a multi-objective optimization problem based on a sub-network of the full model and propose a Sub-network Multiobjective Evolutionary Algorithm (SMOEA) for filter pruning. By progressively pruning the convolutional layers in groups, SMOEA can obtain a lightweight pruned result with better performance.Experiments on VGG-14 model for CIFAR-10 verify the effectiveness of the proposed SMOEA. Specifically, the accuracy of the pruned model with 16.56% parameters decreases by 0.28% only, which is better than the widely used popular filter pruning criteria.

📄 PDF Abstract BibTeX arXiv:2211.01957

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationEvolutionary AlgorithmsModel Compression

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

A Hierarchical Importance-Guided Multi-objective Evolutionary Framework for Deep Neural Network Pruning

2026-04-01 · Zak Khan, Azam Asilian Bidgoli arxiv

The optimization of over-parameterized deep neural networks represents a large-scale, high-dimensional, and strongly non-convex decision problem that challenges existing optimization frameworks. Current evolutionary and …

Network Pruning

CCSRP: Robust Pruning of Spiking Neural Networks through Cooperative Coevolution

2024-07-18 · Zichen Song, Jiakang Li, Songning Lai, Sitan Huang

Spiking neural networks (SNNs) have shown promise in various dynamic visual tasks, yet those ready for practical deployment often lack the compactness and robustness essential in resource-limited and safety-critical sett…

Evolutionary AlgorithmsNetwork Pruning

Multiobjective Evolutionary Pruning of Deep Neural Networks with Transfer Learning for improving their Performance and Robustness

2023-02-20 · Javier Poyatos, Daniel Molina, Aitor Martínez, Javier Del Ser 외

Evolutionary Computation algorithms have been used to solve optimization problems in relation with architectural, hyper-parameter or training configuration, forging the field known today as Neural Architecture Search. Th…

Neural Architecture SearchTransfer Learning

Neural Network Pruning by Cooperative Coevolution

2022-04-12 · Haopu Shang, Jia-Liang Wu, Wenjing Hong, Chao Qian

Neural network pruning is a popular model compression method which can significantly reduce the computing cost with negligible loss of accuracy. Recently, filters are often pruned directly by designing proper criteria or…

Evolutionary AlgorithmsModel CompressionNetwork Pruning

A Multi-objective Complex Network Pruning Framework Based on Divide-and-conquer and Global Performance Impairment Ranking

2023-03-28 · Ronghua Shang, Songling Zhu, Yinan Wu, Weitong Zhang 외

Model compression plays a vital role in the practical deployment of deep neural networks (DNNs), and evolutionary multi-objective (EMO) pruning is an essential tool in balancing the compression rate and performance of th…

Model CompressionNetwork Pruning