paper-with-me

홈 › Papers

Training Keyword Spotters with Limited and Synthesized Speech Data

2020-01-31 · James Lin, Kevin Kilgour, Dominik Roblek, Matthew Sharifi

With the rise of low power speech-enabled devices, there is a growing demand to quickly produce models for recognizing arbitrary sets of keywords. As with many machine learning tasks, one of the most challenging parts in the model creation process is obtaining a sufficient amount of training data. In this paper, we explore the effectiveness of synthesized speech data in training small, spoken term detection models of around 400k parameters. Instead of training such models directly on the audio or low level features such as MFCCs, we use a pre-trained speech embedding model trained to extract useful features for keyword spotting models. Using this speech embedding, we show that a model which detects 10 keywords when trained on only synthetic speech is equivalent to a model trained on over 500 real examples. We also show that a model without our speech embeddings would need to be trained on over 4000 real examples to reach the same accuracy.

📄 PDF Abstract BibTeX arXiv:2002.01322

Code (1)

dscripka/openwakeword pytorch

Tasks

Keyword Spotting

Similar Papers 제목 키워드 기반

Teaching keyword spotters to spot new keywords with limited examples

2021-06-04 · Abhijeet Awasthi, Kevin Kilgour, Hassan Rom

Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets …

Keyword Spotting

Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model

2024-07-26 · Hyun Jin Park, Dhruuv Agarwal, Neng Chen, Rentao Sun 외

This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and …

2kDiversityKeyword Spotting

Training Wake Word Detection with Synthesized Speech Data on Confusion Words

2020-11-03 · Yan Jia, Zexin Cai, Murong Ma, Zeqing Zhao 외

Confusing-words are commonly encountered in real-life keyword spotting applications, which causes severe degradation of performance due to complex spoken terms and various kinds of words that sound similar to the predefi…

Data AugmentationKeyword SpottingSpeech Synthesistext-to-speech+1

Synth4Kws: Synthesized Speech for User Defined Keyword Spotting in Low Resource Environments

2024-07-23 · Pai Zhu, Dhruuv Agarwal, Jacob W. Bartel, Kurt Partridge 외

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We …

DiversityKeyword Spottingtext-to-speechText to Speech

LLM-Synth4KWS: Scalable Automatic Generation and Synthesis of Confusable Data for Custom Keyword Spotting

2025-05-29 · Pai Zhu, Quan Wang, Dhruuv Agarwal, Kurt Partridge

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models ar…

Keyword Spottingtext-to-speechText to Speech