Accelerating Convolutional Neural Network Pruning via Spatial Aura Entropy
In recent years, pruning has emerged as a popular technique to reduce the computational complexity and memory footprint of Convolutional Neural Network (CNN) models. Mutual Information (MI) has been widely used as a criterion for identifying unimportant filters to prune. However, existing methods for MI computation suffer from high computational cost and sensitivity to noise, leading to suboptimal pruning performance. We propose a novel method to improve MI computation for CNN pruning, using the spatial aura entropy. The spatial aura entropy is useful for evaluating the heterogeneity in the distribution of the neural activations over a neighborhood, providing information about local features. Our method effectively improves the MI computation for CNN pruning, leading to more robust and efficient pruning. Experimental results on the CIFAR-10 benchmark dataset demonstrate the superiority of our approach in terms of pruning performance and computational efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyNetwork PruningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning
Visual token pruning is a crucial strategy for accelerating VLMs by compressing redundant image patches, yet existing methods often fail to preserve critical cues under dense instructions and fine-grained queries. In thi…
An Effective Information Theoretic Framework for Channel Pruning
Channel pruning is a promising method for accelerating and compressing convolutional neural networks. However, current pruning algorithms still remain unsolved problems that how to assign layer-wise pruning ratios proper…
Model CompressionBinaural Speech Enhancement Using Deep Complex Convolutional Transformer Networks
Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural spe…
DecoderSpeech EnhancementPruning Convolutional Filters via Reinforcement Learning with Entropy Minimization
Structural pruning has become an integral part of neural network optimization, used to achieve architectural configurations which can be deployed and run more efficiently on embedded devices. Previous results showed that…
reinforcement-learningReinforcement LearningEntropyPrune: Matrix Entropy Guided Visual Token Pruning for Multimodal Large Language Models
Multimodal large language models (MLLMs) incur substantial inference cost due to the processing of hundreds of visual tokens per image. Although token pruning has proven effective for accelerating inference, determining …