Interpreting deep urban sound classification using Layer-wise Relevance Propagation
After constructing a deep neural network for urban sound classification, this work focuses on the sensitive application of assisting drivers suffering from hearing loss. As such, clear etiology justifying and interpreting model predictions comprise a strong requirement. To this end, we used two different representations of audio signals, i.e. Mel and constant-Q spectrograms, while the decisions made by the deep neural network are explained via layer-wise relevance propagation. At the same time, frequency content assigned with high relevance in both feature sets, indicates extremely discriminative information characterizing the present classification task. Overall, we present an explainable AI framework for understanding deep urban sound classification.
Code (1)
Tasks
ClassificationSound ClassificationSimilar Papers 제목 키워드 기반
Environmental Sound Classification on Microcontrollers using Convolutional Neural Networks
Noise is a growing problem in urban areas, and according to the WHO is the second environmental cause of health problems in Europe. Noise monitoring using Wireless Sensor Networks are being applied in order to understand…
ClassificationCPUEnvironmental Sound ClassificationGeneral Classification+1Learning spectro-temporal representations of complex sounds with parameterized neural networks
Deep Learning models have become potential candidates for auditory neuroscience research, thanks to their recent successes on a variety of auditory tasks. Yet, these models often lack interpretability to fully understand…
Action DetectionActivity DetectionSound ClassificationSpeaker VerificationSONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context
We present SONYC-UST-V2, a dataset for urban sound tagging with spatiotemporal information. This dataset is aimed for the development and evaluation of machine listening systems for real-world urban noise monitoring. Whi…
End-to-End Environmental Sound Classification using a 1D Convolutional Neural Network
In this paper, we present an end-to-end approach for environmental sound classification based on a 1D Convolution Neural Network (CNN) that learns a representation directly from the audio signal. Several convolutional la…
Environmental Sound ClassificationGeneral ClassificationSound ClassificationSound-based drone fault classification using multitask learning
The drone has been used for various purposes, including military applications, aerial photography, and pesticide spraying. However, the drone is vulnerable to external disturbances, and malfunction in propellers and moto…
Classification