Do sound event representations generalize to other audio tasks? A case study in audio transfer learning
Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature extraction. Such representations are then used to learn related downstream tasks. In this paper, we investigate transfer learning capacity of audio representations obtained from neural networks trained on a large-scale sound event detection dataset. We build and evaluate these representations across a wide range of other audio tasks, via a simple linear classifier transfer mechanism. We show that such simple linear transfer is already powerful enough to achieve high performance on the downstream tasks. We also provide insights into the attributes of sound event representations that enable such efficient information transfer.
Code (0)
등록된 구현이 없습니다.
Tasks
Event DetectionSound Event DetectionTransfer LearningSimilar Papers 제목 키워드 기반
Learning Multi-Target TDOA Features for Sound Event Localization and Detection
Sound event localization and detection (SELD) systems using audio recordings from a microphone array rely on spatial cues for determining the location of sound events. As a consequence, the localization performance of su…
Sound Event Localization and DetectionHypernetworks build Implicit Neural Representations of Sounds
Implicit Neural Representations (INRs) are nowadays used to represent multimedia signals across various real-life applications, including image super-resolution, image compression, or 3D rendering. Existing methods that …
Image CompressionImage Super-ResolutionMeta-LearningSuper-ResolutionWhat Do Language Models Hear? Probing for Auditory Representations in Language Models
This work explores whether language models encode meaningfully grounded representations of sounds of objects. We learn a linear probe that retrieves the correct text representation of an object given a snippet of audio r…
ObjectLearning Sound Events From Webly Labeled Data
In the last couple of years, weakly labeled learning for sound events has turned out to be an exciting approach for audio event detection. In this work, we introduce webly labeled learning for sound events in which we ai…
Event DetectionSound Event DetectionTransfer LearningBinaural Signal Representations for Joint Sound Event Detection and Acoustic Scene Classification
Sound event detection (SED) and Acoustic scene classification (ASC) are two widely researched audio tasks that constitute an important part of research on acoustic scene analysis. Considering shared information between s…
Acoustic Scene ClassificationEvent DetectionScene ClassificationSound Event Detection