paper-with-me

홈 › Papers

PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognition

2023-12-13 · Chengxi Lei, Satwinder Singh, Feng Hou, Xiaoyun Jia, Ruili Wang

Most of the current speech data augmentation methods operate on either the raw waveform or the amplitude spectrum of speech. In this paper, we propose a novel speech data augmentation method called PhasePerturbation that operates dynamically on the phase spectrum of speech. Instead of statically rotating a phase by a constant degree, PhasePerturbation utilizes three dynamic phase spectrum operations, i.e., a randomization operation, a frequency masking operation, and a temporal masking operation, to enhance the diversity of speech data. We conduct experiments on wav2vec2.0 pre-trained ASR models by fine-tuning them with the PhasePerturbation augmented TIMIT corpus. The experimental results demonstrate 10.9\% relative reduction in the word error rate (WER) compared with the baseline model fine-tuned without any augmentation operation. Furthermore, the proposed method achieves additional improvements (12.9\% and 15.9\%) in WER by complementing the Vocal Tract Length Perturbation (VTLP) and the SpecAug, which are both amplitude spectrum-based augmentation methods. The results highlight the capability of PhasePerturbation to improve the current amplitude spectrum-based augmentation methods.

📄 PDF Abstract BibTeX arXiv:2312.08571

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionData AugmentationDiversityspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Investigation of Data Augmentation Techniques for Disordered Speech Recognition

2022-01-14 · Mengzhe Geng, Xurong Xie, Shansong Liu, Jianwei Yu 외

Disordered speech recognition is a highly challenging task. The underlying neuro-motor conditions of people with speech disorders, often compounded with co-occurring physical disabilities, lead to the difficulty in colle…

Data Augmentationspeech-recognitionSpeech Recognition

A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit

2023-02-27 · Mina Huh, Ruchira Ray, Corey Karnei

Data augmentations are known to improve robustness in speech-processing tasks. In this study, we summarize and compare different data augmentation strategies using S3PRL toolkit. We explore how HuBERT and wav2vec perform…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationPhoneme Recognition+2

Spectral Modification Based Data Augmentation For Improving End-to-End ASR For Children's Speech

2022-03-13 · Vishwanath Pratap Singh, Hardik Sailor, Supratik Bhattacharya, Abhishek Pandey

Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly av…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentationspeech-recognition+1

PhaseAug: A Differentiable Augmentation for Speech Synthesis to Simulate One-to-Many Mapping

2022-11-08 · Junhyeok Lee, Seungu Han, Hyunjae Cho, Wonbin Jung

Previous generative adversarial network (GAN)-based neural vocoders are trained to reconstruct the exact ground truth waveform from the paired mel-spectrogram and do not consider the one-to-many relationship of speech sy…

Generative Adversarial NetworkSpeech Synthesis

FrAUG: A Frame Rate Based Data Augmentation Method for Depression Detection from Speech Signals

2022-02-11 · Vijay Ravi, Jinhan Wang, Jonathan Flint, Abeer Alwan

In this paper, a data augmentation method is proposed for depression detection from speech signals. Samples for data augmentation were created by changing the frame-width and the frame-shift parameters during the feature…

Data AugmentationDepression Detection