Compressing audio CNNs with graph centrality based filter pruning
Convolutional neural networks (CNNs) are commonplace in high-performing solutions to many real-world problems, such as audio classification. CNNs have many parameters and filters, with some having a larger impact on the performance than others. This means that networks may contain many unnecessary filters, increasing a CNN's computation and memory requirements while providing limited performance benefits. To make CNNs more efficient, we propose a pruning framework that eliminates filters with the highest "commonality". We measure this commonality using the graph-theoretic concept of "centrality". We hypothesise that a filter with a high centrality should be eliminated as it represents commonality and can be replaced by other filters without affecting the performance of a network much. An experimental evaluation of the proposed framework is performed on acoustic scene classification and audio tagging. On the DCASE 2021 Task 1A baseline network, our proposed method reduces computations per inference by 71\% with 50\% fewer parameters at less than a two percentage point drop in accuracy compared to the original network. For large-scale CNNs such as PANNs designed for audio tagging, our method reduces 24\% computations per inference with 41\% fewer parameters at a slight improvement in performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Acoustic Scene ClassificationAudio ClassificationAudio TaggingScene ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Estimating Centrality Blindly from Low-pass Filtered Graph Signals
This paper considers blind methods for centrality estimation from graph signals. We model graph signals as the outcome of an unknown low-pass graph filter excited with influences governed by a sparse sub-graph. This mode…
Compressing Deep CNNs using Basis Representation and Spectral Fine-tuning
We propose an efficient and straightforward method for compressing deep convolutional neural networks (CNNs) that uses basis filters to represent the convolutional layers, and optimizes the performance of the compressed …
image-classificationImage Classificationobject-detectionObject DetectionMIMO Graph Filters for Convolutional Neural Networks
Superior performance and ease of implementation have fostered the adoption of Convolutional Neural Networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, p…
Compressing Quaternion Convolutional Neural Networks for Audio Classification
Conventional Convolutional Neural Networks (CNNs) in the real domain have been widely used for audio classification. However, their convolution operations process multi-channel inputs independently, limiting the ability …
Environmental Sound ClassificationSpeech Emotion RecognitionMusic Genre RecognitionKnowledge DistillationRaw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)
This study explores the field of audio classification from raw waveform using Convolutional Neural Networks (CNNs), a method that eliminates the need for extracting specialised features in the pre-processing step. Unlike…
Audio Classification