paper-with-me

Papers

Improving Sound Event Classification by Increasing Shift Invariance in Convolutional Neural Networks

2021-07-01 · Eduardo Fonseca, Andres Ferraro, Xavier Serra

Recent studies have put into question the commonly assumed shift invariance property of convolutional networks, showing that small shifts in the input can affect the output predictions substantially. In this paper, we analyze the benefits of addressing lack of shift invariance in CNN-based sound event classification. Specifically, we evaluate two pooling methods to improve shift invariance in CNNs, based on low-pass filtering and adaptive sampling of incoming feature maps. These methods are implemented via small architectural modifications inserted into the pooling layers of CNNs. We evaluate the effect of these architectural changes on the FSD50K dataset using models of different capacity and in presence of strong regularization. We show that these modifications consistently improve sound event classification in all cases considered. We also demonstrate empirically that the proposed pooling methods increase shift invariance in the network, making it more robust against time/frequency shifts in input spectrograms. This is achieved by adding a negligible amount of trainable parameters, which makes these methods an appealing alternative to conventional pooling layers. The outcome is a new state-of-the-art mAP of 0.541 on the FSD50K classification benchmark.

📄 PDF Abstract BibTeX arXiv:2107.00623

Code (1)

edufonseca/shift_sec 공식 구현 tf

Similar Papers 제목 키워드 기반

Energy Consumption Trends in Sound Event Detection Systems

2024-09-13 · Constance Douwes, Romain Serizel

Deep learning systems have become increasingly energy- and computation-intensive, raising concerns about their environmental impact. As organizers of the Detection and Classification of Acoustic Scenes and Events (DCASE)…

Event DetectionSound Event Detection

ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds

2024-09-13 · Sreyan Ghosh, Sonal Kumar, Chandra Kiran Reddy Evuru, Oriol Nieto 외

Open-vocabulary audio-language models, like CLAP, offer a promising approach for zero-shot audio classification (ZSAC) by enabling classification with any arbitrary set of categories specified with natural language promp…

Audio ClassificationDescriptiveText RetrievalZero-shot Audio Classification

Sound Event Detection Transformer: An Event-based End-to-End Model for Sound Event Detection

2021-10-05 · Zhirong Ye, Xiangdong Wang, Hong Liu, Yueliang Qian 외

Sound event detection (SED) has gained increasing attention with its wide application in surveillance, video indexing, etc. Existing models in SED mainly generate frame-level prediction, converting it into a sequence mul…

Audio TaggingBoundary DetectionEvent DetectionMulti-Label Classification+5

Shift Invariance Can Reduce Adversarial Robustness

2021-03-03 · NeurIPS 2021 12 · Songwei Ge, Vasu Singla, Ronen Basri, David Jacobs

Shift invariance is a critical property of CNNs that improves performance on classification. However, we show that invariance to circular shifts can also lead to greater sensitivity to adversarial attacks. We first chara…

Adversarial Robustness

Feature Aggregation in Joint Sound Classification and Localization Neural Networks

2023-10-29 · Brendan Healy, Patrick McNamee, Zahra Nili Ahmadabadi

This study addresses the application of deep learning techniques in joint sound signal classification and localization networks. Current state-of-the-art sound source localization deep learning networks lack feature aggr…

regressionSound ClassificationSound Event Localization and DetectionSound Source Localization