On Multitask Loss Function for Audio Event Detection and Localization
Audio event localization and detection (SELD) have been commonly tackled using multitask models. Such a model usually consists of a multi-label event classification branch with sigmoid cross-entropy loss for event activity detection and a regression branch with mean squared error loss for direction-of-arrival estimation. In this work, we propose a multitask regression model, in which both (multi-label) event detection and localization are formulated as regression problems and use the mean squared error loss homogeneously for model training. We show that the common combination of heterogeneous loss functions causes the network to underfit the data whereas the homogeneous mean squared error loss leads to better convergence and performance. Experiments on the development and validation sets of the DCASE 2020 SELD task demonstrate that the proposed system also outperforms the DCASE 2020 SELD baseline across all the detection and localization metrics, reducing the overall SELD error (the combined metric) by approximately 10% absolute.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionDirection of Arrival EstimationEvent DetectionregressionSimilar Papers 제목 키워드 기반
Enabling Early Audio Event Detection with Neural Networks
This paper presents a methodology for early detection of audio events from audio streams. Early detection is the ability to infer an ongoing event during its initial stage. The proposed system consists of a novel inferen…
Event DetectionDNN and CNN with Weighted and Multi-task Loss Functions for Audio Event Detection
This report presents our audio event detection system submitted for Task 2, "Detection of rare sound events", of DCASE 2017 challenge. The proposed system is based on convolutional neural networks (CNNs) and deep neural …
Event DetectionTask 2Joint framework with deep feature distillation and adaptive focal loss for weakly supervised audio tagging and acoustic event detection
A good joint training framework is very helpful to improve the performances of weakly supervised audio tagging (AT) and acoustic event detection (AED) simultaneously. In this study, we propose three methods to improve th…
Audio TaggingEvent DetectionDual Normalization Multitasking for Audio-Visual Sounding Object Localization
Although several research works have been reported on audio-visual sound source localization in unconstrained videos, no datasets and metrics have been proposed in the literature to quantitatively evaluate its performanc…
ObjectObject LocalizationSound Source LocalizationUnifying Isolated and Overlapping Audio Event Detection with Multi-Label Multi-Task Convolutional Recurrent Neural Networks
We propose a multi-label multi-task framework based on a convolutional recurrent neural network to unify detection of isolated and overlapping audio events. The framework leverages the power of convolutional recurrent ne…
Event DetectionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION