Applying Phonological Features in Multilingual Text-To-Speech
This study investigates whether phonological features can be applied in text-to-speech systems to generate native and non-native speech in English and Mandarin. We present a mapping of ARPABET/pinyin to SAMPA/SAMPA-SC and then to phonological features. We tested whether this mapping could lead to the successful generation of native, non-native, and code-switched speech in the two languages. We ran two experiments, one with a small dataset and one with a larger dataset. The results proved that phonological features could be used as a feasible input system, although further investigation is needed to improve model performance. The accented output generated by the TTS models also helps with understanding human second language acquisition processes.
Code (1)
Tasks
Language Acquisitiontext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
Applying Feature Underspecified Lexicon Phonological Features in Multilingual Text-to-Speech
This study investigates whether the phonological features derived from the Featurally Underspecified Lexicon model can be applied in text-to-speech systems to generate native and non-native speech in English and Mandarin…
Language Acquisitiontext-to-speechText to SpeechMultilingual and crosslingual speech recognition using phonological-vector based phone embeddings
The use of phonological features (PFs) potentially allows language-specific phones to remain linked in training, which is highly desirable for information sharing for multilingual and crosslingual speech recognition meth…
speech-recognitionSpeech RecognitionMultilingual Phonological Feature Recognition with Self-Supervised Speech Models
Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech mod…
Phonological Features for 0-shot Multilingual Speech Synthesis
Code-switching---the intra-utterance use of multiple languages---is prevalent across the world. Within text-to-speech (TTS), multilingual models have been found to enable code-switching. By modifying the linguistic input…
Speech Synthesistext-to-speechText to SpeechCross-lingual Low Resource Speaker Adaptation Using Phonological Features
The idea of using phonological features instead of phonemes as input to sequence-to-sequence TTS has been recently proposed for zero-shot multilingual speech synthesis. This approach is useful for code-switching, as it f…
Speech Synthesis