paper-with-me

홈 › Papers

Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model

2024-07-26 · Hyun Jin Park, Dhruuv Agarwal, Neng Chen, Rentao Sun, Kurt Partridge, Justin Chen, Harry Zhang, Pai Zhu, Jacob Bartel, Kyle Kastner, Gary Wang, Andrew Rosenberg, Quan Wang

This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and obtaining such training data can be costly. In the current state of the art, TTS models can generate large amounts of natural-sounding data, which can help reducing cost and time for KWS model development. Still, TTS generated data can be lacking diversity compared to real data. To pursue maximizing KWS model accuracy under the constraint of limited resources and current TTS capability, we explored various strategies to mix TTS data and real human speech data, with a focus on minimizing real data use and maximizing diversity of TTS output. Our experimental results indicate that relatively small amounts of real audio data with speaker diversity (100 speakers, 2k utterances) and large amounts of TTS synthesized data can achieve reasonably high accuracy (within 3x error rate of baseline), compared to the baseline (trained with 3.8M real positive utterances).

📄 PDF Abstract BibTeX arXiv:2407.18879

Code (0)

등록된 구현이 없습니다.

Tasks

2kDiversityKeyword Spotting

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Adversarial training of Keyword Spotting to Minimize TTS Data Overfitting

2024-08-20 · Hyun Jin Park, Dhruuv Agarwal, Neng Chen, Rentao Sun 외

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the …

Keyword Spottingtext-to-speechText to Speech

GraphemeAug: A Systematic Approach to Synthesized Hard Negative Keyword Spotting Examples

2025-05-20 · Harry Zhang, Kurt Partridge, Pai Zhu, Neng Chen 외

Spoken Keyword Spotting (KWS) is the task of distinguishing between the presence and absence of a keyword in audio. The accuracy of a KWS model hinges on its ability to correctly classify examples close to the keyword an…

Keyword Spotting

Synth4Kws: Synthesized Speech for User Defined Keyword Spotting in Low Resource Environments

2024-07-23 · Pai Zhu, Dhruuv Agarwal, Jacob W. Bartel, Kurt Partridge 외

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We …

DiversityKeyword Spottingtext-to-speechText to Speech

LLM-Synth4KWS: Scalable Automatic Generation and Synthesis of Confusable Data for Custom Keyword Spotting

2025-05-29 · Pai Zhu, Quan Wang, Dhruuv Agarwal, Kurt Partridge

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models ar…

Keyword Spottingtext-to-speechText to Speech

Auto-KWS 2021 Challenge: Task, Datasets, and Baselines

2021-03-31 · Jingsong Wang, Yuxuan He, Chunyu Zhao, Qijie Shao 외

Auto-KWS 2021 challenge calls for automated machine learning (AutoML) solutions to automate the process of applying machine learning to a customized keyword spotting task. Compared with other keyword spotting tasks, Auto…

AutoMLBIG-bench Machine LearningKeyword Spotting