paper-with-me

홈 › Papers

Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systems

2023-06-03 · Manuele Rusci, Tinne Tuytelaars

A personalized KeyWord Spotting (KWS) pipeline typically requires the training of a Deep Learning model on a large set of user-defined speech utterances, preventing fast customization directly applied on-device. To fill this gap, this paper investigates few-shot learning methods for open-set KWS classification by combining a deep feature encoder with a prototype-based classifier. With user-defined keywords from 10 classes of the Google Speech Command dataset, our study reports an accuracy of up to 76% in a 10-shot scenario while the false acceptance rate of unknown data is kept to 5%. In the analyzed settings, the usage of the triplet loss to train an encoder with normalized output features performs better than the prototypical networks jointly trained with a generator of dummy unknown-class prototypes. This design is also more effective than encoders trained on a classification problem and features fewer parameters than other iso-accuracy approaches.

📄 PDF Abstract BibTeX arXiv:2306.02161

Code (1)

mrusci/ondevice-fewshot-kws 공식 구현 pytorch

Tasks

Few-Shot LearningKeyword SpottingOpen Set LearningTriplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

A 14uJ/Decision Keyword Spotting Accelerator with In-SRAM-Computing and On Chip Learning for Customization

2022-05-10 · Yu-Hsiang Chiang, Tian-Sheuan Chang, Shyh Jye Jou

Keyword spotting has gained popularity as a natural way to interact with consumer devices in recent years. However, because of its always-on nature and the variety of speech, it necessitates a low-power design as well as…

Keyword SpottingQuantization

Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spotting

2022-06-28 · Byeonggeun Kim, Seunghan Yang, Inseop Chung, Simyung Chang

Keyword spotting is the task of detecting a keyword in streaming audio. Conventional keyword spotting targets predefined keywords classification, but there is growing attention in few-shot (query-by-example) keyword spot…

Keyword SpottingMetric LearningOpen Set Learning

Few-Shot Keyword Spotting in Any Language

2021-04-03 · Mark Mazumder, Colby Banbury, Josh Meyer, Pete Warden 외

We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train…

Keyword SpottingTransfer Learning

Keyword spotting using convolutional neural network for speech recognition in Hindi

2026-04-26 · Saru Bharti, Pushparaj Mani Pathak arxiv

In this study, we investigate the application of keyword spotting (KWS) in the domain of Hindi speech recognition, utilizing a dataset comprising 40,000 audio samples. With a sampling rate of 44 kHz and an average durati…

Computational EfficiencyFeature EngineeringSpeech RecognitionKeyword Spotting

Teaching keyword spotters to spot new keywords with limited examples

2021-06-04 · Abhijeet Awasthi, Kevin Kilgour, Hassan Rom

Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets …

Keyword Spotting