ByT5 model for massively multilingual grapheme-to-phoneme conversion
In this study, we tackle massively multilingual grapheme-to-phoneme conversion through implementing G2P models based on ByT5. We have curated a G2P dataset from various sources that covers around 100 languages and trained large-scale multilingual G2P models based on ByT5. We found that ByT5 operating on byte-level inputs significantly outperformed the token-based mT5 model in terms of multilingual G2P. Pairwise comparison with monolingual models in these languages suggests that multilingual ByT5 models generally lower the phone error rate by jointly learning from a variety of languages. The pretrained model can further benefit low resource G2P through zero-shot prediction on unseen languages or provides pretrained weights for finetuning, which helps the model converge to a lower phone error rate than randomly initialized weights. To facilitate future research on multilingual G2P, we make available our code and pretrained multilingual G2P models at: https://github.com/lingjzhu/CharsiuG2P.
Code (1)
Tasks
Grapheme-to-Phoneme ConversionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Massively Multilingual Neural Grapheme-to-Phoneme Conversion
Grapheme-to-phoneme conversion (g2p) is necessary for text-to-speech and automatic speech recognition systems. Most g2p systems are monolingual: they require language-specific data or handcrafting of rules. Such systems …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderGrapheme-to-Phoneme Conversion+4Results of the Second SIGMORPHON Shared Task on Multilingual Grapheme-to-Phoneme Conversion
Grapheme-to-phoneme conversion is an important component in many speech technologies, but until recently there were no multilingual benchmarks for this task. The second iteration of the SIGMORPHON shared task on multilin…
Grapheme-to-Phoneme ConversionGrapheme-to-Phoneme Conversion with a Multilingual Transformer Model
In this paper, we describe our three submissions to the SIGMORPHON 2020 shared task 1 on grapheme-to-phoneme conversion for 15 languages. We experimented with a single multilingual transformer model. We observed that the…
Grapheme-to-Phoneme ConversionThe SIGMORPHON 2020 Shared Task on Multilingual Grapheme-to-Phoneme Conversion
We describe the design and findings of the SIGMORPHON 2020 shared task on multilingual grapheme-to-phoneme conversion. Participants were asked to submit systems which take in a sequence of graphemes in a given language a…
Grapheme-to-Phoneme ConversionFrustratingly Easy Multilingual Grapheme-to-Phoneme Conversion
In this paper, we describe two CU-Boulder submissions to the SIGMORPHON 2020 Task 1 on multilingual grapheme-to-phoneme conversion (G2P). Inspired by the high performance of a standard transformer model (Vaswani et al., …
Grapheme-to-Phoneme Conversion