Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey
With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a comprehensive survey on Pruning, a major compression strategy that removes non-critical or redundant neurons from a CNN model. The survey covers the overarching motivation for pruning, different strategies and criteria, their advantages and drawbacks, along with a compilation of major pruning techniques. We conclude the survey with a discussion on alternatives to pruning and current challenges for the model compression community.
Code (0)
등록된 구현이 없습니다.
Tasks
Model CompressionSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Structured Probabilistic Pruning for Convolutional Neural Network Acceleration
In this paper, we propose a novel progressive parameter pruning method for Convolutional Neural Network acceleration, named Structured Probabilistic Pruning (SPP), which effectively prunes weights of convolutional layers…
Transfer LearningGoPrune: Accelerated Structured Pruning with $\ell_{2,p}$-Norm Optimization
Convolutional neural networks (CNNs) suffer from rapidly increasing storage and computational costs as their depth grows, which severely hinders their deployment on resource-constrained edge devices. Pruning is a practic…
Computational EfficiencyNetwork PruningEfficient Model-Based Deep Learning via Network Pruning and Fine-Tuning
Model-based deep learning (MBDL) is a powerful methodology for designing deep models to solve imaging inverse problems. MBDL networks can be seen as iterative algorithms that estimate the desired image using a physical m…
Deep LearningImage ReconstructionImage Super-ResolutionNetwork Pruning+1CATRO: Channel Pruning via Class-Aware Trace Ratio Optimization
Deep convolutional neural networks are shown to be overkill with high parametric and computational redundancy in many application scenarios, and an increasing number of works have explored model pruning to obtain lightwe…
Cluster Pruning: An Efficient Filter Pruning Method for Edge AI Vision Applications
Even though the Convolutional Neural Networks (CNN) has shown superior results in the field of computer vision, it is still a challenging task to implement computer vision algorithms in real-time at the edge, especially …
CPUGPUQuantization