paper-with-me

홈 › Papers

Comparison of semi-supervised deep learning algorithms for audio classification

2021-02-16 · Léo Cances, Etienne Labbé, Thomas Pellegrini

In this article, we adapted five recent SSL methods to the task of audio classification. The first two methods, namely Deep Co-Training (DCT) and Mean Teacher (MT), involve two collaborative neural networks. The three other algorithms, called MixMatch (MM), ReMixMatch (RMM), and FixMatch (FM), are single-model methods that rely primarily on data augmentation strategies. Using the Wide-ResNet-28-2 architecture in all our experiments, 10% of labeled data and the remaining 90% as unlabeled data for training, we first compare the error rates of the five methods on three standard benchmark audio datasets: Environmental Sound Classification (ESC-10), UrbanSound8K (UBS8K), and Google Speech Commands (GSC). In all but one cases, MM, RMM, and FM outperformed MT and DCT significantly, MM and RMM being the best methods in most experiments. On UBS8K and GSC, MM achieved 18.02% and 3.25% error rate (ER), respectively, outperforming models trained with 100% of the available labeled data, which reached 23.29% and 4.94%, respectively. RMM achieved the best results on ESC-10 (12.00% ER), followed by FM which reached 13.33%. Second, we explored adding the mixup augmentation, used in MM and RMM, to DCT, MT, and FM. In almost all cases, mixup brought consistent gains. For instance, on GSC, FM reached 4.44% and 3.31% ER without and with mixup. Our PyTorch code will be made available upon paper acceptance at https:// github. com/ Labbe ti/ SSLH.

📄 PDF Abstract BibTeX arXiv:2102.08183

Code (1)

Labbeti/SSLH 공식 구현 pytorch

Tasks

Audio ClassificationAudio TaggingData AugmentationDeep LearningEnvironmental Sound ClassificationObject RecognitionSound Classification

Methods 이 논문이 사용한 방법론

FixMatch FixMatch is an algorithm that first generates pseudo-labels using the model's predictions on weakly-augmented unlabeled images. For a given image, the pseudo-label is only…
Residual Connection 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Average Pooling 설명 없음

Similar Papers 제목 키워드 기반

Deep Semi-Supervised Learning for Time Series Classification

2021-02-06 · Jann Goschenhofer, Rasmus Hvingelby, David Rügamer, Janek Thomas 외

While Semi-supervised learning has gained much attention in computer vision on image data, yet limited research exists on its applicability in the time series domain. In this work, we investigate the transferability of s…

ClassificationData AugmentationGeneral ClassificationTime Series+2

Examining the Classification Accuracy of TSVMs with ?Feature Selection in Comparison with the GLAD Algorithm

2013-07-04 · Hala Helmi, Jon M. Garibaldi, Uwe Aickelin

Gene expression data sets are used to classify and predict patient diagnostic categories. As we know, it is extremely difficult and expensive to obtain gene expression labelled examples. Moreover, conventional supervised…

ClassificationDiagnosticfeature selectionGeneral Classification

A Preliminary Study on Environmental Sound Classification Leveraging Large-Scale Pretrained Model and Semi-Supervised Learning

2021-10-01 · ROCLING 2021 10 · You-Sheng Tsao, Tien-Hong Lo, Jiun-Ting Li, Shi-Yan Weng 외

With the widespread commercialization of smart devices, research on environmental sound classification has gained more and more attention in recent years. In this paper, we set out to make effective use of large-scale au…

ClassificationData AugmentationEnvironmental Sound ClassificationSound Classification+1

A Comparison of Semi-Supervised Learning Techniques for Streaming ASR at Scale

2023-04-19 · Cal Peyser, Michael Picheny, Kyunghyun Cho, Rohit Prabhavalkar 외

Unpaired text and audio injection have emerged as dominant methods for improving ASR performance in the absence of a large labeled corpus. However, little guidance exists on deploying these methods to improve production …

CPUDecoder

SpliceOut: A Simple and Efficient Audio Augmentation Method

2021-09-30 · Arjit Jain, Pranay Reddy Samala, Deepak Mittal, Preethi Jyoti 외

Time masking has become a de facto augmentation technique for speech and audio tasks, including automatic speech recognition (ASR) and audio classification, most notably as a part of SpecAugment. In this work, we propose…

Audio ClassificationAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Music Classification+4