Low-Complexity Models for Acoustic Scene Classification Based on Receptive Field Regularization and Frequency Damping
Deep Neural Networks are known to be very demanding in terms of computing and memory requirements. Due to the ever increasing use of embedded systems and mobile devices with a limited resource budget, designing low-complexity models without sacrificing too much of their predictive performance gained great importance. In this work, we investigate and compare several well-known methods to reduce the number of parameters in neural networks. We further put these into the context of a recent study on the effect of the Receptive Field (RF) on a model's performance, and empirically show that we can achieve high-performing low-complexity models by applying specific restrictions on the RFs, in combination with parameter reduction methods. Additionally, we propose a filter-damping technique for regularizing the RF of models, without altering their architecture and changing their parameter counts. We will show that incorporating this technique improves the performance in various low-complexity settings such as pruning and decomposed convolution. Using our proposed filter damping, we achieved the 1st rank at the DCASE-2020 Challenge in the task of Low-Complexity Acoustic Scene Classification.
Code (1)
Tasks
Acoustic Scene ClassificationScene ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TC-SKNet with GridMask for Low-complexity Classification of Acoustic scene
Convolution neural networks (CNNs) have good performance in low-complexity classification tasks such as acoustic scene classifications (ASCs). However, there are few studies on the relationship between the length of targ…
AutoMLData AugmentationDomain Generalization on Efficient Acoustic Scene Classification using Residual Normalization
It is a practical research topic how to deal with multi-device audio inputs by a single acoustic scene classification system with efficient design. In this work, we propose Residual Normalization, a novel feature normali…
Acoustic Scene ClassificationClassificationDomain GeneralizationKnowledge Distillation+3Emotion and Theme Recognition in Music with Frequency-Aware RF-Regularized CNNs
We present CP-JKU submission to MediaEval 2019; a Receptive Field-(RF)-regularized and Frequency-Aware CNN approach for tagging music with emotion/mood labels. We perform an investigation regarding the impact of the RF o…
Acoustic Scene ClassificationScene ClassificationQTI Submission to DCASE 2021: residual normalization for device-imbalanced acoustic scene classification with efficient design
This technical report describes the details of our TASK1A submission of the DCASE2021 challenge. The goal of the task is to design an audio scene classification system for device-imbalanced datasets under the constraints…
Acoustic Scene ClassificationKnowledge DistillationModel CompressionQuantization+1Receptive-field-regularized CNN variants for acoustic scene classification
Acoustic scene classification and related tasks have been dominated by Convolutional Neural Networks (CNNs). Top-performing CNNs use mainly audio spectograms as input and borrow their architectural design primarily from …
Acoustic Scene ClassificationClassificationGeneral ClassificationScene Classification