Improving Proper Noun Recognition in End-to-End ASR By Customization of the MWER Loss Criterion
Proper nouns present a challenge for end-to-end (E2E) automatic speech recognition (ASR) systems in that a particular name may appear only rarely during training, and may have a pronunciation similar to that of a more common word. Unlike conventional ASR models, E2E systems lack an explicit pronounciation model that can be specifically trained with proper noun pronounciations and a language model that can be trained on a large text-only corpus. Past work has addressed this issue by incorporating additional training data or additional models. In this paper, we instead build on recent advances in minimum word error rate (MWER) training to develop two new loss criteria that specifically emphasize proper noun recognition. Unlike past work on this problem, this method requires no new data during training or external models during inference. We see improvements ranging from 2% to 7% relative on several relevant benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage ModellingProper Nounspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Input Length Matters: Improving RNN-T and MWER Training for Long-form Telephony Speech Recognition
End-to-end models have achieved state-of-the-art results on several automatic speech recognition tasks. However, they perform poorly when evaluated on long-form data, e.g., minutes long conversational telephony audio. On…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Formspeech-recognition+1Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Integrating external language models (LMs) into end-to-end (E2E) models remains a challenging task for domain-adaptive speech recognition. Recently, internal language model estimation (ILME)-based LM fusion has shown sig…
Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionImproving Rare Word Recognition with LM-aware MWER Training
Language models (LMs) significantly improve the recognition accuracy of end-to-end (E2E) models on words rarely seen during training, when used in either the shallow fusion or the rescoring setups. In this work, we intro…
Distillation Strategies for Discriminative Speech Recognition Rescoring
Second-pass rescoring is employed in most state-of-the-art speech recognition systems. Recently, BERT based models have gained popularity for re-ranking the n-best hypothesis by exploiting the knowledge from masked langu…
Language ModelingLanguage ModellingRe-Rankingspeech-recognition+1RescoreBERT: Discriminative Speech Recognition Rescoring with BERT
Second-pass rescoring is an important component in automatic speech recognition (ASR) systems that is used to improve the outputs from a first-pass decoder by implementing a lattice rescoring or $n$-best re-ranking. Whil…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderLanguage Modelling+4