paper-with-me

홈 › Papers

Wav2KWS: Transfer Learning from Speech Representations for Keyword Spotting

2021-05-10 · D.J SEO, H.S OH, Y.C JUNG

With the expanding development of on-device artificial intelligence, voice-enabled devices such as smart speakers, wearables, and other on-device or edge processing systems have been proposed. However, building or obtaining large training datasets that are essential for robust keyword spotting (KWS) remains cumbersome. To address this problem, we propose a deep neural network that can rapidly establish a high-performance KWS system from arbitrary keyword instruction sets. We use an encoder pretrained with a large-scale speech corpus as the backbone network and then design an effective transfer network for KWS. To demonstrate the feasibility of the proposed network, various experiments were conducted on Google Speech Command Datasets V1 and V2. In addition, to verify the applicability of the network for different languages, we conducted experiments using three different Korean speech command datasets. The proposed network outperforms state-of-the-art deep neural networks in both experiments. Furthermore, the proposed network can understand real human voice even when trained with synthetic text-to-speech data.

📄 PDF Abstract BibTeX

Code (1)

qute012/Wav2Keyword pytorch

Tasks

Keyword Spottingtext-to-speechText to SpeechTransfer Learning

Similar Papers 제목 키워드 기반

Prototypical Metric Transfer Learning for Continuous Speech Keyword Spotting With Limited Training Data

2019-01-12 · Harshita Seth, Pulkit Kumar, Muktabh Mayank Srivastava

Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spottin…

General Classificationimbalanced classificationKeyword SpottingTransfer Learning

Metric Learning for User-defined Keyword Spotting

2022-11-01 · Jaemin Jung, Youkyum Kim, Jihwan Park, Youshin Lim 외

The goal of this work is to detect new spoken terms defined by users. While most previous works address Keyword Spotting (KWS) as a closed-set classification problem, this limits their transferability to unseen terms. Th…

Keyword SpottingMetric Learning

Teaching keyword spotters to spot new keywords with limited examples

2021-06-04 · Abhijeet Awasthi, Kevin Kilgour, Hassan Rom

Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets …

Keyword Spotting

Recycle Your Wav2Vec2 Codebook: A Speech Perceiver for Keyword Spotting

2022-10-01 · COLING 2022 10 · Guillermo Cámbara, Jordi Luque, Mireia Farrús

Speech information in a pretrained wav2vec2.0 model is usually leveraged through its encoder, which has at least 95M parameters, being not so suitable for small footprint Keyword Spotting. In this work, we show an effici…

Keyword SpottingSmall-Footprint Keyword Spotting

Few-Shot Keyword Spotting in Any Language

2021-04-03 · Mark Mazumder, Colby Banbury, Josh Meyer, Pete Warden 외

We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train…

Keyword SpottingTransfer Learning