Synthetic Data Generation for Phrase Break Prediction with Large Language Model
Current approaches to phrase break prediction address crucial prosodic aspects of text-to-speech systems but heavily rely on vast human annotations from audio or text, incurring significant manual effort and cost. Inherent variability in the speech domain, driven by phonetic factors, further complicates acquiring consistent, high-quality data. Recently, large language models (LLMs) have shown success in addressing data challenges in NLP by generating tailored synthetic data while reducing manual annotation needs. Motivated by this, we explore leveraging LLM to generate synthetic phrase break annotations, addressing the challenges of both manual annotation and speech-related tasks by comparing with traditional annotations and assessing effectiveness across multiple languages. Our findings suggest that LLM-based synthetic data generation effectively mitigates data challenges in phrase break prediction and highlights the potential of LLMs as a viable solution for the speech domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Synthetic Data GenerationSimilar Papers 제목 키워드 기반
An investigation of phrase break prediction in an End-to-End TTS system
Purpose: This work explores the use of external phrase break prediction models to enhance listener comprehension in End-to-End Text-to-Speech (TTS) systems. Methods: The effectiveness of these models is evaluated based o…
Predictiontext-to-speechText to SpeechCross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model
Phrase break prediction is a crucial task for improving the prosody naturalness of a text-to-speech (TTS) system. However, most proposed phrase break prediction models are monolingual, trained exclusively on a large amou…
Cross-Lingual TransferLanguage ModelingLanguage ModellingPrediction+3Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis
We propose a novel phrase break prediction method that combines implicit features extracted from a pre-trained large language model, a.k.a BERT, and explicit features extracted from BiLSTM with linguistic features. In co…
Language ModelingLanguage ModellingLarge Language ModelSentence+4Open-Source Boundary-Annotated Corpus for Arabic Speech and Language Processing
A boundary-annotated and part-of-speech tagged corpus is a prerequisite for developing phrase break classifiers. Boundary annotations in English speech corpora are descriptive, delimiting intonation units perceived by th…
ChunkingDescriptiveSpeech SynthesisText-To-Speech SynthesisUnsupervised Domain Adaptation for Keyphrase Generation using Citation Contexts
Adapting keyphrase generation models to new domains typically involves few-shot fine-tuning with in-domain labeled data. However, annotating documents with keyphrases is often prohibitively expensive and impractical, req…
Domain AdaptationKeyphrase GenerationUnsupervised Domain Adaptation