paper-with-me

홈 › Papers

Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model

2023-06-05 · Hoyeon Lee, Hyun-Wook Yoon, Jong-Hwan Kim, Jae-Min Kim

Phrase break prediction is a crucial task for improving the prosody naturalness of a text-to-speech (TTS) system. However, most proposed phrase break prediction models are monolingual, trained exclusively on a large amount of labeled data. In this paper, we address this issue for low-resource languages with limited labeled data using cross-lingual transfer. We investigate the effectiveness of zero-shot and few-shot cross-lingual transfer for phrase break prediction using a pre-trained multilingual language model. We use manually collected datasets in four Indo-European languages: one high-resource language and three with limited resources. Our findings demonstrate that cross-lingual transfer learning can be a particularly effective approach, especially in the few-shot setting, for improving performance in low-resource languages. This suggests that cross-lingual transfer can be inexpensive and effective for developing TTS front-end in resource-poor languages.

📄 PDF Abstract BibTeX arXiv:2306.02579

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Lingual TransferLanguage ModelingLanguage ModellingPredictiontext-to-speechText to SpeechTransfer Learning

Similar Papers 제목 키워드 기반

Improving cross-lingual model transfer by chunking

2020-02-27 · Ayan Das, Sudeshna Sarkar

We present a shallow parser guided cross-lingual model transfer approach in order to address the syntactic differences between source and target languages more effectively. In this work, we assume the chunks or phrases i…

ChunkingmodelSentence

Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer

2023-06-20 · Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Giuseppe Coccia 외

Speech generation for machine dubbing adds complexity to conventional Text-To-Speech solutions as the generated output is required to match the expressiveness, emotion and speaking rate of the source content. Capturing a…

text-to-speechText to Speech

Cross-Lingual Phrase Retrieval

2022-04-19 · ACL 2022 5 · Heqi Zheng, Xiao Zhang, Zewen Chi, Heyan Huang 외

Cross-lingual retrieval aims to retrieve relevant text across languages. Current methods typically achieve cross-lingual retrieval by learning language-agnostic text representations in word or sentence level. However, ho…

RetrievalSentence

Cross-lingual Transfer Learning for COVID-19 Outbreak Alignment

2020-06-05 · ACL 2020 7 · Sharon Levy, William Yang Wang

The spread of COVID-19 has become a significant and troubling aspect of society in 2020. With millions of cases reported across countries, new outbreaks have occurred and followed patterns of previously affected areas. M…

Cross-Lingual TransferTransfer Learning

Cross-Lingual Abstractive Summarization with Limited Parallel Resources

2021-05-28 · ACL 2021 5 · Yu Bai, Yang Gao, Heyan Huang

Parallel cross-lingual summarization data is scarce, requiring models to better use the limited available cross-lingual resources. Existing methods to do so often adopt sequence-to-sequence networks with multi-task frame…

Abstractive Text SummarizationCross-Lingual Abstractive SummarizationDecoderTransfer Learning