Improving grapheme-to-phoneme conversion by learning pronunciations from speech recordings
The Grapheme-to-Phoneme (G2P) task aims to convert orthographic input into a discrete phonetic representation. G2P conversion is beneficial to various speech processing applications, such as text-to-speech and speech recognition. However, these tend to rely on manually-annotated pronunciation dictionaries, which are often time-consuming and costly to acquire. In this paper, we propose a method to improve the G2P conversion task by learning pronunciation examples from audio recordings. Our approach bootstraps a G2P with a small set of annotated examples. The G2P model is used to train a multilingual phone recognition system, which then decodes speech recordings with a phonetic representation. Given hypothesized phoneme labels, we learn pronunciation dictionaries for out-of-vocabulary words, and we use those to re-train the G2P system. Results indicate that our approach consistently improves the phone error rate of G2P systems across languages and amount of available data.
Code (0)
등록된 구현이 없습니다.
Tasks
Grapheme-to-Phoneme Conversionspeech-recognitionSpeech Recognitiontext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
An Investigation of the Relation Between Grapheme Embeddings and Pronunciation for Tacotron-based Systems
End-to-end models, particularly Tacotron-based ones, are currently a popular solution for text-to-speech synthesis. They allow the production of high-quality synthesized speech with little to no text preprocessing. Indee…
Grapheme-to-Phoneme ConversionRelationSpeech Synthesistext-to-speech+2Multitask Learning for Grapheme-to-Phoneme Conversion of Anglicisms in German Speech Recognition
Anglicisms are a challenge in German speech recognition. Due to their irregular pronunciation compared to native German words, automatically generated pronunciation dictionaries often include faulty phoneme sequences for…
Grapheme-to-Phoneme Conversionspeech-recognitionSpeech RecognitionTransformer based Grapheme-to-Phoneme Conversion
Attention mechanism is one of the most successful techniques in deep learning based Natural Language Processing (NLP). The transformer network architecture is completely based on attention mechanisms, and it outperforms …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Grapheme-to-Phoneme ConversionMachine Translation+5r-G2P: Evaluating and Enhancing Robustness of Grapheme to Phoneme Conversion by Controlled noise introducing and Contextual information incorporation
Grapheme-to-phoneme (G2P) conversion is the process of converting the written form of words to their pronunciations. It has an important role for text-to-speech (TTS) synthesis and automatic speech recognition (ASR) syst…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Grapheme-to-Phoneme Conversionspeech-recognition+3g2pM: A Neural Grapheme-to-Phoneme Conversion Package for Mandarin Chinese Based on a New Open Benchmark Dataset
Conversion of Chinese graphemes to phonemes (G2P) is an essential component in Mandarin Chinese Text-To-Speech (TTS) systems. One of the biggest challenges in Chinese G2P conversion is how to disambiguate the pronunciati…
Grapheme-to-Phoneme ConversionPolyphone disambiguationtext-to-speechText to Speech