Developing multilingual speech synthesis system for Ojibwe, Mi'kmaq, and Maliseet
We present lightweight flow matching multilingual text-to-speech (TTS) systems for Ojibwe, Mi'kmaq, and Maliseet, three Indigenous languages in North America. Our results show that training a multilingual TTS model on three typologically similar languages can improve the performance over monolingual models, especially when data are scarce. Attention-free architectures are highly competitive with self-attention architecture with higher memory efficiency. Our research not only advances technical development for the revitalization of low-resource languages but also highlights the cultural gap in human evaluation protocols, calling for a more community-centered approach to human evaluation.
Code (1)
Tasks
Speech Synthesistext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE
This paper presents an analysis of speech synthesis quality achieved by simultaneously performing voice conversion and language code-switching using multilingual VQ-VAE speech synthesis in German, French, English and Ita…
Speech SynthesisVoice ConversionMultilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration
This work aims to build a multilingual text-to-speech (TTS) synthesis system for ten lower-resourced Turkic languages: Azerbaijani, Bashkir, Kazakh, Kyrgyz, Sakha, Tatar, Turkish, Turkmen, Uyghur, and Uzbek. We specifica…
Speech Synthesistext-to-speechText to SpeechText-To-Speech Synthesis+2Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization
Developing high-quality text-to-speech (TTS) systems for low-resource languages is challenging due to the scarcity of paired text and speech data. In contrast, automatic speech recognition (ASR) models for such languages…
Speaker VerificationSpeech RecognitionBytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytes
We present two end-to-end models: Audio-to-Byte (A2B) and Byte-to-Audio (B2A), for multilingual speech recognition and synthesis. Prior work has predominantly used characters, sub-words or words as the unit of choice to …
Allspeech-recognitionSpeech RecognitionSpeech SynthesisLeveraging Parameter-Efficient Transfer Learning for Multi-Lingual Text-to-Speech Adaptation
Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthe…
Speech Synthesistext-to-speechText to SpeechTransfer Learning