paper-with-me

홈 › Papers

Unsupervised Contrastive Learning of Sound Event Representations

2020-11-15 · Eduardo Fonseca, Diego Ortego, Kevin McGuinness, Noel E. O'Connor, Xavier Serra

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised contrastive learning as a way to learn sound event representations. To this end, we propose to use the pretext task of contrasting differently augmented views of sound events. The views are computed primarily via mixing of training examples with unrelated backgrounds, followed by other data augmentations. We analyze the main components of our method via ablation experiments. We evaluate the learned representations using linear evaluation, and in two in-domain downstream sound event classification tasks, namely, using limited manually labeled data, and using noisy labeled data. Our results suggest that unsupervised contrastive pre-training can mitigate the impact of data scarcity and increase robustness against noisy labels, outperforming supervised baselines.

📄 PDF Abstract BibTeX arXiv:2011.07616

Code (1)

edufonseca/uclser20 공식 구현 pytorch

Tasks

Contrastive LearningLinear evaluationRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Self-Supervised Learning from Automatically Separated Sound Scenes

2021-05-05 · Eduardo Fonseca, Aren Jansen, Daniel P. W. Ellis, Scott Wisdom 외

Real-world sound scenes consist of time-varying collections of sound sources, each generating characteristic sound events that are mixed together in audio recordings. The association of these constituent sound events wit…

Contrastive LearningSelf-Supervised Learning

Self-supervised learning of audio representations using angular contrastive loss

2022-11-10 · Shanshan Wang, Soumya Tripathy, Annamaria Mesaros

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically si…

Contrastive LearningSelf-Supervised Learning

CLEVE: Contrastive Pre-training for Event Extraction

2021-05-30 · ACL 2021 5 · Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin 외

Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed…

Contrastive LearningEvent Extraction

Unsupervised Improvement of Audio-Text Cross-Modal Representations

2023-05-03 · Zhepei Wang, Cem Subakan, Krishna Subramani, Junkai Wu 외

Recent advances in using language models to obtain cross-modal audio-text representations have overcome the limitations of conventional training approaches that use predefined labels. This has allowed the community to ma…

Acoustic Scene ClassificationClassificationScene Classificationzero-shot-classification+1

MultiSoundGen: Video-to-Audio Generation for Multi-Event Scenarios via SlowFast Contrastive Audio-Visual Pretraining and Direct Preference Optimization

2025-09-24 · Jianxuan Yang, Xiaoran Yang, Lipan Zhang, Xinyue Guo 외 arxiv

Current video-to-audio (V2A) methods struggle in complex multi-event scenarios (video scenarios involving multiple sound sources, sound events, or transitions) due to two critical limitations. First, existing methods fac…

Audio Generation