paper-with-me

홈 › Papers

Sound Event Detection with Depthwise Separable and Dilated Convolutions

2020-02-02 · Konstantinos Drossos, Stylianos I. Mimilakis, Shayan Gharib, Yanxiong Li, Tuomas Virtanen

State-of-the-art sound event detection (SED) methods usually employ a series of convolutional neural networks (CNNs) to extract useful features from the input audio signal, and then recurrent neural networks (RNNs) to model longer temporal context in the extracted features. The number of the channels of the CNNs and size of the weight matrices of the RNNs have a direct effect on the total amount of parameters of the SED method, which is to a couple of millions. Additionally, the usually long sequences that are used as an input to an SED method along with the employment of an RNN, introduce implications like increased training time, difficulty at gradient flow, and impeding the parallelization of the SED method. To tackle all these problems, we propose the replacement of the CNNs with depthwise separable convolutions and the replacement of the RNNs with dilated convolutions. We compare the proposed method to a baseline convolutional neural network on a SED task, and achieve a reduction of the amount of parameters by 85% and average training time per epoch by 78%, and an increase the average frame-wise F1 score and reduction of the average error rate by 4.6% and 3.8%, respectively.

📄 PDF Abstract BibTeX arXiv:2002.00476

Code (1)

dr-costas/dnd-sed 공식 구현 pytorch

Tasks

Event DetectionSound Event Detection

Similar Papers 제목 키워드 기반

Conditioned Time-Dilated Convolutions for Sound Event Detection

2020-07-10 · Konstantinos Drossos, Stylianos I. Mimilakis, Tuomas Virtanen

Sound event detection (SED) is the task of identifying sound events along with their onset and offset times. A recent, convolutional neural networks based SED method, proposed the usage of depthwise separable (DWS) and t…

Event DetectionLanguage ModellingSound Event Detection

Domestic Activities Classification from Audio Recordings Using Multi-scale Dilated Depthwise Separable Convolutional Network

2023-06-09 · Yufei Zeng, Yanxiong Li, Zhenfeng Zhou, Ruiqi Wang 외

Domestic activities classification (DAC) from audio recordings aims at classifying audio recordings into pre-defined categories of domestic activities, which is an effective way for estimation of daily activities perform…

Towards Lightweight Hyperspectral Image Super-Resolution with Depthwise Separable Dilated Convolutional Network

2025-05-01 · Usman Muhammad, Jorma Laaksonen, Lyudmila Mihaylova

Deep neural networks have demonstrated highly competitive performance in super-resolution (SR) for natural images by learning mappings from low-resolution (LR) to high-resolution (HR) images. However, hyperspectral super…

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

Sound event detection via dilated convolutional recurrent neural networks

2020-07-20

Convolutional recurrent neural networks (CRNNs) have achieved state-of-the-art performance for sound event detection (SED). In this paper, we propose to use a dilated CRNN, namely a CRNN with a dilated convolutional kern…

Event DetectionSound Event Detection

Depthwise Separable Temporal Convolutional Network for Action Segmentation

2021-01-19 · 2020 International Conference on 3D Vision (3DV) 2021 1 · Basavaraj Hampiholi, Christian Jarvers, Wolfgang Mader, Heiko Neumann

Fine-grained temporal action segmentation in long, untrimmed RGB videos is a key topic in visual human- machine interaction. Recent temporal convolution based approaches either use encoder-decoder(ED) architecture or …

Action SegmentationDecoderTemporal Action Segmentation