Training sound event detection with soft labels from crowdsourced annotations
In this paper, we study the use of soft labels to train a system for sound event detection (SED). Soft labels can result from annotations which account for human uncertainty about categories, or emerge as a natural representation of multiple opinions in annotation. Converting annotations to hard labels results in unambiguous categories for training, at the cost of losing the details about the labels distribution. This work investigates how soft labels can be used, and what benefits they bring in training a SED system. The results show that the system is capable of learning information about the activity of the sounds which is reflected in the soft labels and is able to detect sounds that are missed in the typical binary target training setup. We also release a new dataset produced through crowdsourcing, containing temporally strong labels for sound events in real-life recordings, with both soft and hard labels.
Code (0)
등록된 구현이 없습니다.
Tasks
Event DetectionSound Event DetectionSimilar Papers 제목 키워드 기반
Development of a Respiratory Sound Labeling Software for Training a Deep Learning-Based Respiratory Sound Analysis Model
Respiratory auscultation can help healthcare professionals detect abnormal respiratory conditions if adventitious lung sounds are heard. The state-of-the-art artificial intelligence technologies based on deep learning sh…
Deep LearningEvent DetectionDCASE 2024 Task 4: Sound Event Detection with Heterogeneous Data and Missing Labels
The Detection and Classification of Acoustic Scenes and Events Challenge Task 4 aims to advance sound event detection (SED) systems in domestic environments by leveraging training data with different supervision uncertai…
Event DetectionMissing LabelsSound Event DetectionInteractive Dual-Conformer with Scene-Inspired Mask for Soft Sound Event Detection
Traditional binary hard labels for sound event detection (SED) lack details about the complexity and variability of sound event distributions. Recently, a novel annotation workflow is proposed to generate fine-grained no…
Event DetectionSound Event DetectionPower pooling: An adaptive pooling function for weakly labelled sound event detection
Access to large corpora with strongly labelled sound events is expensive and difficult in engineering applications. Much research turns to address the problem of how to detect both the types and the timestamps of sound e…
Event DetectionMultiple Instance LearningSound Event DetectionCross-Referencing Self-Training Network for Sound Event Detection in Audio Mixtures
Sound event detection is an important facet of audio tagging that aims to identify sounds of interest and define both the sound category and time boundaries for each sound event in a continuous recording. With advances i…
Audio TaggingEvent DetectionSound Event Detection