paper-with-me

홈 › Papers

Single-shot Channel Pruning Based on Alternating Direction Method of Multipliers

2019-02-18 · Chengcheng Li, Zi Wang, Xiangyang Wang, Hairong Qi

Channel pruning has been identified as an effective approach to constructing efficient network structures. Its typical pipeline requires iterative pruning and fine-tuning. In this work, we propose a novel single-shot channel pruning approach based on alternating direction methods of multipliers (ADMM), which can eliminate the need for complex iterative pruning and fine-tuning procedure and achieve a target compression ratio with only one run of pruning and fine-tuning. To the best of our knowledge, this is the first study of single-shot channel pruning. The proposed method introduces filter-level sparsity during training and can achieve competitive performance with a simple heuristic pruning criterion (L1-norm). Extensive evaluations have been conducted with various widely-used benchmark architectures and image datasets for object classification purpose. The experimental results on classification accuracy show that the proposed method can outperform state-of-the-art network pruning works under various scenarios.

📄 PDF Abstract BibTeX arXiv:1902.06382

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationNetwork Pruning

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Systematic Weight Pruning of DNNs using Alternating Direction Method of Multipliers

2018-02-15 · Tianyun Zhang, Shaokai Ye, Yi-Peng Zhang, Yanzhi Wang 외

We present a systematic weight pruning framework of deep neural networks (DNNs) using the alternating direction method of multipliers (ADMM). We first formulate the weight pruning problem of DNNs as a constrained nonconv…

Computational Efficiency

Single Shot Structured Pruning Before Training

2020-07-01 · Joost van Amersfoort, Milad Alizadeh, Sebastian Farquhar, Nicholas Lane 외

We introduce a method to speed up training by 2x and inference by 3x in deep neural networks using structured pruning applied before training. Unlike previous works on pruning before training which prune individual weigh…

Sensitivity

Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networks

2026-05-20 · Qishi Zhan, Ziheng Chen, Minxuan Hu arxiv

One-shot magnitude pruning can cause severe accuracy collapse in the high-sparsity regime, even when the pruning mask preserves the largest weights. We argue that this failure reflects a granularity mismatch in post-prun…

Alternating projections gridless covariance-based estimation for DOA

2021-02-12 · Yongsung Park, Peter Gerstoft

We present a gridless sparse iterative covariance-based estimation method based on alternating projections for direction-of-arrival (DOA) estimation. The gridless DOA estimation is formulated in the reconstruction of Toe…

A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers

2018-04-10 · ECCV 2018 9 · Tianyun Zhang, Shaokai Ye, Kaiqi Zhang, Jian Tang 외

Weight pruning methods for deep neural networks (DNNs) have been investigated recently, but prior work in this area is mainly heuristic, iterative pruning, thereby lacking guarantees on the weight reduction ratio and con…

Image ClassificationNetwork Pruning