Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systems
A personalized KeyWord Spotting (KWS) pipeline typically requires the training of a Deep Learning model on a large set of user-defined speech utterances, preventing fast customization directly applied on-device. To fill this gap, this paper investigates few-shot learning methods for open-set KWS classification by combining a deep feature encoder with a prototype-based classifier. With user-defined keywords from 10 classes of the Google Speech Command dataset, our study reports an accuracy of up to 76% in a 10-shot scenario while the false acceptance rate of unknown data is kept to 5%. In the analyzed settings, the usage of the triplet loss to train an encoder with normalized output features performs better than the prototypical networks jointly trained with a generator of dummy unknown-class prototypes. This design is also more effective than encoders trained on a classification problem and features fewer parameters than other iso-accuracy approaches.
Code (1)
Tasks
Few-Shot LearningKeyword SpottingOpen Set LearningTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A 14uJ/Decision Keyword Spotting Accelerator with In-SRAM-Computing and On Chip Learning for Customization
Keyword spotting has gained popularity as a natural way to interact with consumer devices in recent years. However, because of its always-on nature and the variety of speech, it necessitates a low-power design as well as…
Keyword SpottingQuantizationDummy Prototypical Networks for Few-Shot Open-Set Keyword Spotting
Keyword spotting is the task of detecting a keyword in streaming audio. Conventional keyword spotting targets predefined keywords classification, but there is growing attention in few-shot (query-by-example) keyword spot…
Keyword SpottingMetric LearningOpen Set LearningFew-Shot Keyword Spotting in Any Language
We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train…
Keyword SpottingTransfer LearningKeyword spotting using convolutional neural network for speech recognition in Hindi
In this study, we investigate the application of keyword spotting (KWS) in the domain of Hindi speech recognition, utilizing a dataset comprising 40,000 audio samples. With a sampling rate of 44 kHz and an average durati…
Computational EfficiencyFeature EngineeringSpeech RecognitionKeyword SpottingTeaching keyword spotters to spot new keywords with limited examples
Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets …
Keyword Spotting