paper-with-me

Papers

A One-step Pruning-recovery Framework for Acceleration of Convolutional Neural Networks

2019-06-18 · Dong Wang, Lei Zhou, Xiao Bai, Jun Zhou

Acceleration of convolutional neural network has received increasing attention during the past several years. Among various acceleration techniques, filter pruning has its inherent merit by effectively reducing the number of convolution filters. However, most filter pruning methods resort to tedious and time-consuming layer-by-layer pruning-recovery strategy to avoid a significant drop of accuracy. In this paper, we present an efficient filter pruning framework to solve this problem. Our method accelerates the network in one-step pruning-recovery manner with a novel optimization objective function, which achieves higher accuracy with much less cost compared with existing pruning methods. Furthermore, our method allows network compression with global filter pruning. Given a global pruning rate, it can adaptively determine the pruning rate for each single convolutional layer, while these rates are often set as hyper-parameters in previous approaches. Evaluated on VGG-16 and ResNet-50 using ImageNet, our approach outperforms several state-of-the-art methods with less accuracy drop under the same and even much fewer floating-point operations (FLOPs).

📄 PDF Abstract BibTeX arXiv:1906.07488

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Structured Probabilistic Pruning for Convolutional Neural Network Acceleration

2017-09-20 · Huan Wang, Qiming Zhang, Yuehai Wang, Haoji Hu

In this paper, we propose a novel progressive parameter pruning method for Convolutional Neural Network acceleration, named Structured Probabilistic Pruning (SPP), which effectively prunes weights of convolutional layers…

Transfer Learning

DBP: Discrimination Based Block-Level Pruning for Deep Model Acceleration

2019-12-21 · Wenxiao Wang, Shuai Zhao, Minghao Chen, Jinming Hu 외

Neural network pruning is one of the most popular methods of accelerating the inference of deep convolutional neural networks (CNNs). The dominant pruning methods, filter-level pruning methods, evaluate their performance…

Network Pruning

PRUNING WITH HINTS: AN EFFICIENT FRAMEWORK FOR MODEL ACCELERATION

2019-05-01 · ICLR 2019 5 · Wei Gao, Yi Wei, Quanquan Li, Hongwei Qin 외

In this paper, we propose an efficient framework to accelerate convolutional neural networks. We utilize two types of acceleration methods: pruning and hints. Pruning can reduce model size by removing channels of layers.…

Pose Estimation

Rethinking Depth Pruning for Vision Transformers: A Heterogeneity-Aware Perspective

2026-07-04 · Zhenfeng Su, Kang Zhao, Han Bao, Tao Yuan 외 arxiv

While prior studies have successfully compressed vision Transformers (ViTs) through various pruning techniques, most have concentrated on width pruning to achieve significant reductions in model size. Depth pruning, whic…

SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformer

2026-03-07 · Tong Shao, Yusen Fu, Guoying Sun, Jingde Kong 외 arxiv

Diffusion Transformers have become a dominant paradigm in visual generation, yet their low inference efficiency remains a key bottleneck hindering further advancement. Among common training-free techniques, caching offer…