paper-with-me

Papers

Compressing audio CNNs with graph centrality based filter pruning

2023-05-05 · James A King, Arshdeep Singh, Mark D. Plumbley

Convolutional neural networks (CNNs) are commonplace in high-performing solutions to many real-world problems, such as audio classification. CNNs have many parameters and filters, with some having a larger impact on the performance than others. This means that networks may contain many unnecessary filters, increasing a CNN's computation and memory requirements while providing limited performance benefits. To make CNNs more efficient, we propose a pruning framework that eliminates filters with the highest "commonality". We measure this commonality using the graph-theoretic concept of "centrality". We hypothesise that a filter with a high centrality should be eliminated as it represents commonality and can be replaced by other filters without affecting the performance of a network much. An experimental evaluation of the proposed framework is performed on acoustic scene classification and audio tagging. On the DCASE 2021 Task 1A baseline network, our proposed method reduces computations per inference by 71\% with 50\% fewer parameters at less than a two percentage point drop in accuracy compared to the original network. For large-scale CNNs such as PANNs designed for audio tagging, our method reduces 24\% computations per inference with 41\% fewer parameters at a slight improvement in performance.

📄 PDF Abstract BibTeX arXiv:2305.03391

Code (0)

등록된 구현이 없습니다.

Tasks

Acoustic Scene ClassificationAudio ClassificationAudio TaggingScene Classification

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Estimating Centrality Blindly from Low-pass Filtered Graph Signals

2019-10-29

This paper considers blind methods for centrality estimation from graph signals. We model graph signals as the outcome of an unknown low-pass graph filter excited with influences governed by a sparse sub-graph. This mode…

Compressing Deep CNNs using Basis Representation and Spectral Fine-tuning

2021-05-21 · Muhammad Tayyab, Fahad Ahmad Khan, Abhijit Mahalanobis

We propose an efficient and straightforward method for compressing deep convolutional neural networks (CNNs) that uses basis filters to represent the convolutional layers, and optimizes the performance of the compressed …

image-classificationImage Classificationobject-detectionObject Detection

MIMO Graph Filters for Convolutional Neural Networks

2018-03-06 · Fernando Gama, Antonio G. Marques, Alejandro Ribeiro, Geert Leus

Superior performance and ease of implementation have fostered the adoption of Convolutional Neural Networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, p…

Compressing Quaternion Convolutional Neural Networks for Audio Classification

2025-10-24 · Arshdeep Singh, Vinayak Abrol, Mark D. Plumbley arxiv

Conventional Convolutional Neural Networks (CNNs) in the real domain have been widely used for audio classification. However, their convolution operations process multi-channel inputs independently, limiting the ability …

Environmental Sound ClassificationSpeech Emotion RecognitionMusic Genre RecognitionKnowledge Distillation

Raw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)

2024-11-30 · Kazi Nazmul Haque, Rajib Rana, Tasnim Jarin, Bjorn W. Schuller Jr

This study explores the field of audio classification from raw waveform using Convolutional Neural Networks (CNNs), a method that eliminates the need for extracting specialised features in the pre-processing step. Unlike…

Audio Classification