paper-with-me

홈 › Papers

Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration

2018-11-01 · CVPR 2019 6 · Yang He, Ping Liu, Ziwei Wang, Zhilan Hu, Yi Yang

Previous works utilized ''smaller-norm-less-important'' criterion to prune filters with smaller norm values in a convolutional neural network. In this paper, we analyze this norm-based criterion and point out that its effectiveness depends on two requirements that are not always met: (1) the norm deviation of the filters should be large; (2) the minimum norm of the filters should be small. To solve this problem, we propose a novel filter pruning method, namely Filter Pruning via Geometric Median (FPGM), to compress the model regardless of those two requirements. Unlike previous methods, FPGM compresses CNN models by pruning filters with redundancy, rather than those with ''relatively less'' importance. When applied to two image classification benchmarks, our method validates its usefulness and strengths. Notably, on CIFAR-10, FPGM reduces more than 52% FLOPs on ResNet-110 with even 2.69% relative accuracy improvement. Moreover, on ILSVRC-2012, FPGM reduces more than 42% FLOPs on ResNet-101 without top-5 accuracy drop, which has advanced the state-of-the-art. Code is publicly available on GitHub: https://github.com/he-y/filter-pruning-geometric-median

📄 PDF Abstract BibTeX arXiv:1811.00250

Code (3)

he-y/filter-pruning-geometric-median 공식 구현 pytorch
BlossomingL/compression_tool pytorch
PaddlePaddle/PaddleOCR paddle

Tasks

image-classificationImage Classification

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

A One-step Pruning-recovery Framework for Acceleration of Convolutional Neural Networks

2019-06-18 · Dong Wang, Lei Zhou, Xiao Bai, Jun Zhou

Acceleration of convolutional neural network has received increasing attention during the past several years. Among various acceleration techniques, filter pruning has its inherent merit by effectively reducing the numbe…

Filter-Pruning of Lightweight Face Detectors Using a Geometric Median Criterion

2023-11-28 · Konstantinos Gkrispanis, Nikolaos Gkalelis, Vasileios Mezaris

Face detectors are becoming a crucial component of many applications, including surveillance, that often have to run on edge devices with limited processing power and memory. Therefore, there's a pressing demand for comp…

Face DetectionNetwork Pruning

DBP: Discrimination Based Block-Level Pruning for Deep Model Acceleration

2019-12-21 · Wenxiao Wang, Shuai Zhao, Minghao Chen, Jinming Hu 외

Neural network pruning is one of the most popular methods of accelerating the inference of deep convolutional neural networks (CNNs). The dominant pruning methods, filter-level pruning methods, evaluate their performance…

Network Pruning

Progressive Local Filter Pruning for Image Retrieval Acceleration

2020-01-24 · Xiaodong Wang, Zhedong Zheng, Yang He, Fei Yan 외

This paper focuses on network pruning for image retrieval acceleration. Prevailing image retrieval works target at the discriminative feature learning, while little attention is paid to how to accelerate the model infere…

Image RetrievalNetwork PruningPerson Re-IdentificationRetrieval

Novel Adaptive Binary Search Strategy-First Hybrid Pyramid- and Clustering-Based CNN Filter Pruning Method without Parameters Setting

2020-06-08 · Kuo-Liang Chung, Yu-Lun Chang, Bo-Wei Tsai

Pruning redundant filters in CNN models has received growing attention. In this paper, we propose an adaptive binary search-first hybrid pyramid- and clustering-based (ABSHPC-based) method for pruning filters automatical…

Clustering