Wav2KWS: Transfer Learning from Speech Representations for Keyword Spotting
With the expanding development of on-device artificial intelligence, voice-enabled devices such as smart speakers, wearables, and other on-device or edge processing systems have been proposed. However, building or obtaining large training datasets that are essential for robust keyword spotting (KWS) remains cumbersome. To address this problem, we propose a deep neural network that can rapidly establish a high-performance KWS system from arbitrary keyword instruction sets. We use an encoder pretrained with a large-scale speech corpus as the backbone network and then design an effective transfer network for KWS. To demonstrate the feasibility of the proposed network, various experiments were conducted on Google Speech Command Datasets V1 and V2. In addition, to verify the applicability of the network for different languages, we conducted experiments using three different Korean speech command datasets. The proposed network outperforms state-of-the-art deep neural networks in both experiments. Furthermore, the proposed network can understand real human voice even when trained with synthetic text-to-speech data.
Code (1)
Tasks
Keyword Spottingtext-to-speechText to SpeechTransfer LearningSimilar Papers 제목 키워드 기반
Prototypical Metric Transfer Learning for Continuous Speech Keyword Spotting With Limited Training Data
Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spottin…
General Classificationimbalanced classificationKeyword SpottingTransfer LearningMetric Learning for User-defined Keyword Spotting
The goal of this work is to detect new spoken terms defined by users. While most previous works address Keyword Spotting (KWS) as a closed-set classification problem, this limits their transferability to unseen terms. Th…
Keyword SpottingMetric LearningTeaching keyword spotters to spot new keywords with limited examples
Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets …
Keyword SpottingRecycle Your Wav2Vec2 Codebook: A Speech Perceiver for Keyword Spotting
Speech information in a pretrained wav2vec2.0 model is usually leveraged through its encoder, which has at least 95M parameters, being not so suitable for small footprint Keyword Spotting. In this work, we show an effici…
Keyword SpottingSmall-Footprint Keyword SpottingFew-Shot Keyword Spotting in Any Language
We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train…
Keyword SpottingTransfer Learning