paper-with-me

홈 › Papers

Semi-supervsied Learning-based Sound Event Detection using Freuqency Dynamic Convolution with Large Kernel Attention for DCASE Challenge 2023 Task 4

2023-06-10 · Ji Won Kim, Sang Won Son, Yoonah Song, Hong Kook Kim, Il Hoon Song, Jeong Eun Lim

This report proposes a frequency dynamic convolution (FDY) with a large kernel attention (LKA)-convolutional recurrent neural network (CRNN) with a pre-trained bidirectional encoder representation from audio transformers (BEATs) embedding-based sound event detection (SED) model that employs a mean-teacher and pseudo-label approach to address the challenge of limited labeled data for DCASE 2023 Task 4. The proposed FDY with LKA integrates the FDY and LKA module to effectively capture time-frequency patterns, long-term dependencies, and high-level semantic information in audio signals. The proposed FDY with LKA-CRNN with a BEATs embedding network is initially trained on the entire DCASE 2023 Task 4 dataset using the mean-teacher approach, generating pseudo-labels for weakly labeled, unlabeled, and the AudioSet. Subsequently, the proposed SED model is retrained using the same pseudo-label approach. A subset of these models is selected for submission, demonstrating superior F1-scores and polyphonic SED score performance on the DCASE 2023 Challenge Task 4 validation dataset.

📄 PDF Abstract BibTeX arXiv:2306.06461

Code (0)

등록된 구현이 없습니다.

Tasks

Event DetectionPseudo LabelSound Event Detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Cross-Referencing Self-Training Network for Sound Event Detection in Audio Mixtures

2021-05-27 · Sangwook Park, David K. Han, Mounya Elhilali

Sound event detection is an important facet of audio tagging that aims to identify sounds of interest and define both the sound category and time boundaries for each sound event in a continuous recording. With advances i…

Audio TaggingEvent DetectionSound Event Detection

RCRNN-based Sound Event Detection System with Specific Speech Resolution

2021-10-01 · ROCLING 2021 10 · Sung-Jen Huang, Yih-Wen Wang, Chia-Ping Chen, Chung-Li Lu 외

Sound event detection (SED) system outputs sound events and their time boundaries in audio signals. We proposed an RCRNN-based SED system with residual connection and convolution block attention mechanism based on the me…

Data AugmentationEvent DetectionSound Event Detection

RCT: Random Consistency Training for Semi-supervised Sound Event Detection

2021-10-21 · Nian Shao, Erfan Loweimi, Xiaofei Li

Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringi…

Data AugmentationEvent DetectionSound Event Detection

Guided learning for weakly-labeled semi-supervised sound event detection

2019-06-06 · Liwei Lin, Xiangdong Wang, Hong Liu, Yueliang Qian

We propose a simple but efficient method termed Guided Learning for weakly-labeled semi-supervised sound event detection (SED). There are two sub-targets implied in weakly-labeled SED: audio tagging and boundary detectio…

Audio TaggingBoundary DetectionEvent DetectionGeneral Classification+1

Peer Collaborative Learning for Polyphonic Sound Event Detection

2021-10-07 · Hayato Endo, Hiromitsu Nishizaki

This paper describes that semi-supervised learning called peer collaborative learning (PCL) can be applied to the polyphonic sound event detection (PSED) task, which is one of the tasks in the Detection and Classificatio…

Event DetectionKnowledge DistillationSound Event Detection