Self Training and Ensembling Frequency Dependent Networks with Coarse Prediction Pooling and Sound Event Bounding Boxes
To tackle sound event detection (SED), we propose frequency dependent networks (FreDNets), which heavily leverage frequency-dependent methods. We apply frequency warping and FilterAugment, which are frequency-dependent data augmentation methods. The model architecture consists of 3 branches: audio teacher-student transformer (ATST) branch, BEATs branch and CNN branch including either partial dilated frequency dynamic convolution (PDFD conv) or squeeze-and-Excitation (SE) with time-frame frequency-wise SE (tfwSE). To train MAESTRO labels with coarse temporal resolution, we applied max pooling on prediction for the MAESTRO dataset. Using best ensemble model, we applied self training to obtain pseudo label from DESED weak set, unlabeled set and AudioSet. AudioSet pseudo labels, filtered to focus on high-confidence labels, are used to train on DESED dataset only. We used change-detection-based sound event bounding boxes (cSEBBs) as post processing for ensemble models on self training and submission models. The resulting FreDNet was ranked 2nd in DCASE 2024 Challenge Task 4.
Code (1)
Tasks
Change DetectionData AugmentationEvent DetectionPseudo LabelSound Event DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Investigating Multi-Feature Selection and Ensembling for Audio Classification
Deep Learning (DL) algorithms have shown impressive performance in diverse domains. Among them, audio has attracted many researchers over the last couple of decades due to some interesting patterns--particularly in class…
Audio ClassificationClassificationfeature selectionDomain Confusion with Self Ensembling for Unsupervised Adaptation
Data collection and annotation are time-consuming in machine learning, expecially for large scale problem. A common approach for this problem is to transfer knowledge from a related labeled domain to a target one. There …
Domain AdaptationUnsupervised Domain AdaptationRobust Self-Ensembling Network for Hyperspectral Image Classification
Recent research has shown the great potential of deep learning algorithms in the hyperspectral image (HSI) classification task. Nevertheless, training these models usually requires a large amount of labeled data. Since t…
ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+1Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation
Deep learning-based semantic segmentation methods have an intrinsic limitation that training a model requires a large amount of data with pixel-level annotations. To address this challenging issue, many researchers give …
Data AugmentationDomain AdaptationSegmentationSemantic Segmentation+1Mean Embeddings with Test-Time Data Augmentation for Ensembling of Representations
Averaging predictions over a set of models -- an ensemble -- is widely used to improve predictive performance and uncertainty estimation of deep learning models. At the same time, many machine learning systems, such as s…
Data AugmentationImage RetrievalLinear evaluationRecommendation Systems+1