Learning to Detect Novel and Fine-Grained Acoustic Sequences Using Pretrained Audio Representations
This work investigates pretrained audio representations for few shot Sound Event Detection. We specifically address the task of few shot detection of novel acoustic sequences, or sound events with semantically meaningful temporal structure, without assuming access to non-target audio. We develop procedures for pretraining suitable representations, and methods which transfer them to our few shot learning scenario. Our experiments evaluate the general purpose utility of our pretrained representations on AudioSet, and the utility of proposed few shot methods via tasks constructed from real-world acoustic sequences. Our pretrained embeddings are suitable to the proposed task, and enable multiple aspects of our few shot framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Event DetectionFew-Shot LearningSound Event DetectionSimilar Papers 제목 키워드 기반
Audiovisual transfer learning for audio tagging and sound event detection
We study the merit of transfer learning for two sound recognition problems, i.e., audio tagging and sound event detection. Employing feature fusion, we adapt a baseline system utilizing only spectral acoustic inputs to a…
Audio TaggingEvent DetectionSound Event DetectionTransfer LearningAcoustic models of Brazilian Portuguese Speech based on Neural Transformers
An acoustic model, trained on a significant amount of unlabeled data, consists of a self-supervised learned speech representation useful for solving downstream tasks, perhaps after a fine-tuning of the model in the respe…
Hierarchical Self-Supervised Representation Learning for Depression Detection from Speech
Speech-based depression detection (SDD) has emerged as a non-invasive and scalable alternative to conventional clinical assessments. However, existing methods still struggle to capture robust depression-related speech ch…
Self-Supervised LearningRepresentation LearningRead What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy
Automatic speech recognition systems commonly rely on reference transcriptions for evaluation, while reference-free approaches often depend on internal confidence estimation or auxiliary language models. We propose READ …
Speech RecognitionMasked Autoencoders with Limited Data: Does It Work? A Fine-Grained Bioacoustics Case Study
Bioacoustic recognition requires fine-grained acoustic understanding to distinguish similar-sounding species. However, many large-scale data repositories such as iNaturalist are weakly annotated, often with only a single…
Self-Supervised Learning