PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognition
Most of the current speech data augmentation methods operate on either the raw waveform or the amplitude spectrum of speech. In this paper, we propose a novel speech data augmentation method called PhasePerturbation that operates dynamically on the phase spectrum of speech. Instead of statically rotating a phase by a constant degree, PhasePerturbation utilizes three dynamic phase spectrum operations, i.e., a randomization operation, a frequency masking operation, and a temporal masking operation, to enhance the diversity of speech data. We conduct experiments on wav2vec2.0 pre-trained ASR models by fine-tuning them with the PhasePerturbation augmented TIMIT corpus. The experimental results demonstrate 10.9\% relative reduction in the word error rate (WER) compared with the baseline model fine-tuned without any augmentation operation. Furthermore, the proposed method achieves additional improvements (12.9\% and 15.9\%) in WER by complementing the Vocal Tract Length Perturbation (VTLP) and the SpecAug, which are both amplitude spectrum-based augmentation methods. The results highlight the capability of PhasePerturbation to improve the current amplitude spectrum-based augmentation methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionData AugmentationDiversityspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Investigation of Data Augmentation Techniques for Disordered Speech Recognition
Disordered speech recognition is a highly challenging task. The underlying neuro-motor conditions of people with speech disorders, often compounded with co-occurring physical disabilities, lead to the difficulty in colle…
Data Augmentationspeech-recognitionSpeech RecognitionA Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit
Data augmentations are known to improve robustness in speech-processing tasks. In this study, we summarize and compare different data augmentation strategies using S3PRL toolkit. We explore how HuBERT and wav2vec perform…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationPhoneme Recognition+2Spectral Modification Based Data Augmentation For Improving End-to-End ASR For Children's Speech
Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly av…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentationspeech-recognition+1PhaseAug: A Differentiable Augmentation for Speech Synthesis to Simulate One-to-Many Mapping
Previous generative adversarial network (GAN)-based neural vocoders are trained to reconstruct the exact ground truth waveform from the paired mel-spectrogram and do not consider the one-to-many relationship of speech sy…
Generative Adversarial NetworkSpeech SynthesisFrAUG: A Frame Rate Based Data Augmentation Method for Depression Detection from Speech Signals
In this paper, a data augmentation method is proposed for depression detection from speech signals. Samples for data augmentation were created by changing the frame-width and the frame-shift parameters during the feature…
Data AugmentationDepression Detection