Semi-supervised ASR by End-to-end Self-training
While deep learning based end-to-end automatic speech recognition (ASR) systems have greatly simplified modeling pipelines, they suffer from the data sparsity issue. In this work, we propose a self-training method with an end-to-end system for semi-supervised ASR. Starting from a Connectionist Temporal Classification (CTC) system trained on the supervised data, we iteratively generate pseudo-labels on a mini-batch of unsupervised utterances with the current model, and use the pseudo-labels to augment the supervised data for immediate model update. Our method retains the simplicity of end-to-end ASR systems, and can be seen as performing alternating optimization over a well-defined learning objective. We also perform empirical investigations of our method, regarding the effect of data augmentation, decoding beamsize for pseudo-label generation, and freshness of pseudo-labels. On a commonly used semi-supervised ASR setting with the WSJ corpus, our method gives 14.4% relative WER improvement over a carefully-trained base system with data augmentation, reducing the performance gap between the base system and the oracle system by 50%.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationPseudo Labelspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning
This paper introduces SelfMatch, a semi-supervised learning method that combines the power of contrastive self-supervised learning and consistency regularization. SelfMatch consists of two stages: (1) self-supervised pre…
Contrastive LearningSelf-Supervised LearningSemi-Supervised Image ClassificationSelf-supervised Mean Teacher for Semi-supervised Chest X-ray Classification
The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due…
Contrastive LearningGeneral ClassificationMedical Image AnalysisMulti-class Classification+4A Self-Training Method for Semi-Supervised GANs
Since the creation of Generative Adversarial Networks (GANs), much work has been done to improve their training stability, their generated image quality, their range of application but nearly none of them explored their …
Data AugmentationThe GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation
We consider the task of semi-supervised semantic segmentation, where we aim to produce pixel-wise semantic object masks given only a small number of human-labeled training examples. We focus on iterative self-training me…
Semantic SegmentationSemi-Supervised Semantic SegmentationSelf-semi-supervised Learning to Learn from NoisyLabeled Data
The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research …