paper-with-me

홈 › Papers

Confident magnitude-based neural network pruning

2024-08-08 · Joaquin Alvarez

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a sizable reduction in the number of parameters of a deep neural network without deteriorating its predictive capacity in one-shot pruning regimes. Our work builds beyond this background in order to provide rigorous uncertainty quantification for pruning neural networks reliably, which has not been addressed to a great extent in previous literature focusing on pruning methods in computer vision settings. We leverage recent techniques on distribution-free uncertainty quantification to provide finite-sample statistical guarantees to compress deep neural networks, while maintaining high performance. Moreover, this work presents experiments in computer vision tasks to illustrate how uncertainty-aware pruning is a useful approach to deploy sparse neural networks safely.

📄 PDF Abstract BibTeX arXiv:2408.04759

Code (0)

등록된 구현이 없습니다.

Tasks

Network PruningUncertainty Quantification

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Advancing IIoT with Over-the-Air Federated Learning: The Role of Iterative Magnitude Pruning

2024-03-21 · Fazal Muhammad Ali Khan, Hatem Abou-zeid, Aryan Kaushik, Syed Ali Hassan

The industrial Internet of Things (IIoT) under Industry 4.0 heralds an era of interconnected smart devices where data-driven insights and machine learning (ML) fuse to revolutionize manufacturing. A noteworthy developmen…

Federated LearningModel Compression

Lookahead: a Far-Sighted Alternative of Magnitude-based Pruning

2020-02-12 · ICLR 2020 1 · Sejun Park, Jaeho Lee, Sangwoo Mo, Jinwoo Shin

Magnitude-based pruning is one of the simplest methods for pruning neural networks. Despite its simplicity, magnitude-based pruning and its variants demonstrated remarkable performances for pruning modern architectures. …

Quantifying lottery tickets under label noise: accuracy, calibration, and complexity

2023-06-21 · Viplove Arora, Daniele Irto, Sebastian Goldt, Guido Sanguinetti

Pruning deep neural networks is a widely used strategy to alleviate the computational burden in machine learning. Overwhelming empirical evidence suggests that pruned models retain very high accuracy even with a tiny fra…

Catalyst: a Novel Regularizer for Structured Pruning with Auxiliary Extension of Parameter Space

2025-07-10 · Jaeheun Jung, Donghun Lee arxiv

Structured pruning aims to reduce the size and computational cost of deep neural networks by removing entire filters or channels. The traditional regularizers such as L1 or Group Lasso and its variants lead to magnitude-…

Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning

2024-03-22 · Tausifa Jan Saleem, Ramanjit Ahuja, Surendra Prasad, Brejesh lall

Lottery ticket hypothesis for deep neural networks emphasizes the importance of initialization used to re-train the sparser networks obtained using the iterative magnitude pruning process. An explanation for why the spec…