paper-with-me

Papers

CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics

2020-09-08 · Guan Li, Junpeng Wang, Han-Wei Shen, Kaixin Chen, Guihua Shan, Zhonghua Lu

Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with limited computational resources, e.g., mobile/embedded devices. The emerging topic of model pruning strives to address this problem by removing less important neurons and fine-tuning the pruned networks to minimize the accuracy loss. Nevertheless, existing automated pruning solutions often rely on a numerical threshold of the pruning criteria, lacking the flexibility to optimally balance the trade-off between model size and accuracy. Moreover, the complicated interplay between the stages of neuron pruning and model fine-tuning makes this process opaque, and therefore becomes difficult to optimize. In this paper, we address these challenges through a visual analytics approach, named CNNPruner. It considers the importance of convolutional filters through both instability and sensitivity, and allows users to interactively create pruning plans according to a desired goal on model size or accuracy. Also, CNNPruner integrates state-of-the-art filter visualization techniques to help users understand the roles that different filters played and refine their pruning plans. Through comprehensive case studies on CNNs with real-world sizes, we validate the effectiveness of CNNPruner.

📄 PDF Abstract BibTeX arXiv:2009.09940

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Convolutional Network Fabric Pruning With Label Noise

2022-02-15 · Ilias Benjelloun, Bart Lamiroy, Efoevi Koudou

This paper presents an iterative pruning strategy for Convolutional Network Fabrics (CNF) in presence of noisy training and testing data. With the continuous increase in size of neural network models, various authors hav…

Fine-Pruning: Joint Fine-Tuning and Compression of a Convolutional Network with Bayesian Optimization

2017-07-28 · Frederick Tung, Srikanth Muralidharan, Greg Mori

When approaching a novel visual recognition problem in a specialized image domain, a common strategy is to start with a pre-trained deep neural network and fine-tune it to the specialized domain. If the target domain cov…

Bayesian OptimizationNetwork Pruning

Arena: A Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics

2024-04-14 · Haosong Peng, Wei Feng, Hao Li, Yufeng Zhan 외

The advent of edge computing has made real-time intelligent video analytics feasible. Previous works, based on traditional model architecture (e.g., CNN, RNN, etc.), employ various strategies to filter out non-region-of-…

Edge-computing

VAC-CNN: A Visual Analytics System for Comparative Studies of Deep Convolutional Neural Networks

2021-10-25 · Xiwei Xuan, XiaoYu Zhang, Oh-Hyun Kwon, Kwan-Liu Ma

The rapid development of Convolutional Neural Networks (CNNs) in recent years has triggered significant breakthroughs in many machine learning (ML) applications. The ability to understand and compare various CNN models a…

image-classificationImage Classification

Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks

2023-03-06 · Yiran Li, Junpeng Wang, Takanori Fujiwara, Kwan-Liu Ma

Adversarial attacks on a convolutional neural network (CNN) -- injecting human-imperceptible perturbations into an input image -- could fool a high-performance CNN into making incorrect predictions. The success of advers…

Autonomous DrivingMedical DiagnosisVisual Reasoning