Supervised Contrastive Learning for Accented Speech Recognition
Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech recognition. To build different views (similar "positive" data samples) for contrastive learning, three data augmentation techniques including noise injection, spectrogram augmentation and TTS-same-sentence generation are further investigated. From the experiments on the Common Voice dataset, we have shown that contrastive learning helps to build data-augmentation invariant and pronunciation invariant representations, which significantly outperforms traditional joint training methods in both zero-shot and full-shot settings. Experiments show that contrastive learning can improve accuracy by 3.66% (zero-shot) and 3.78% (full-shot) on average, comparing to the joint training method.
Code (0)
등록된 구현이 없습니다.
Tasks
Accented Speech RecognitionContrastive LearningData AugmentationSentencespeech-recognitionSpeech RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Accented Speech Recognition using Data Augmentation based on Unsupervised Text-to-Speech Synthesis
This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training…
Accented Speech RecognitionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentation+7Clustering and Mining Accented Speech for Inclusive and Fair Speech Recognition
Modern automatic speech recognition (ASR) systems are typically trained on more than tens of thousands hours of speech data, which is one of the main factors for their great success. However, the distribution of such dat…
Unsupervised Accent Adaptation Through Masked Language Model Correction Of Discrete Self-Supervised Speech Units
Self-supervised pre-trained speech models have strongly improved speech recognition, yet they are still sensitive to domain shifts and accented or atypical speech. Many of these models rely on quantisation or clustering …
Accented Speech RecognitionLanguage ModelingLanguage Modellingspeech-recognition+1Improving Accent Identification and Accented Speech Recognition Under a Framework of Self-supervised Learning
Recently, self-supervised pre-training has gained success in automatic speech recognition (ASR). However, considering the difference between speech accents in real scenarios, how to identify accents and use accent featur…
Accented Speech RecognitionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Self-Supervised Learning+2Leveraging Native Language Speech for Accent Identification using Deep Siamese Networks
The problem of automatic accent identification is important for several applications like speaker profiling and recognition as well as for improving speech recognition systems. The accented nature of speech can be primar…
Speaker Profilingspeech-recognitionSpeech Recognition