paper-with-me

홈 › Papers

Progressive Continual Learning for Spoken Keyword Spotting

2022-01-29 · Yizheng Huang, Nana Hou, Nancy F. Chen

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. To tackle such challenges, we propose a progressive continual learning strategy for small-footprint spoken keyword spotting (PCL-KWS). Specifically, the proposed PCL-KWS framework introduces a network instantiator to generate the task-specific sub-networks for remembering previously learned keywords. As a result, the PCL-KWS approach incrementally learns new keywords without forgetting prior knowledge. Besides, the keyword-aware network scaling mechanism of PCL-KWS constrains the growth of model parameters while achieving high performance. Experimental results show that after learning five new tasks sequentially, our proposed PCL-KWS approach archives the new state-of-the-art performance of 92.8% average accuracy for all the tasks on Google Speech Command dataset compared with other baselines.

📄 PDF Abstract BibTeX arXiv:2201.12546

Code (2)

huangyz0918/kws-continual-learning 공식 구현 pytorch
swagshaw/rainbow-keywords pytorch

Tasks

Continual LearningKeyword Spotting

Similar Papers 제목 키워드 기반

Dark Experience for Incremental Keyword Spotting

2024-09-12 · Tianyi Peng, Yang Xiao

Spoken keyword spotting (KWS) is crucial for identifying keywords within audio inputs and is widely used in applications like Apple Siri and Google Home, particularly on edge devices. Current deep learning-based KWS syst…

Continual LearningKeyword Spotting

AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting

2025-05-17 · Yang Xiao, Tianyi Peng, Rohan Kumar Das, Yuchen Hu 외

Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem…

class-incremental learningClass Incremental LearningContinual LearningExemplar-Free+3

AraSpot: Arabic Spoken Command Spotting

2023-03-29 · Mahmoud Salhab, Haidar Harmanani

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunti…

Data AugmentationKeyword SpottingSynthetic Data Generationtext-to-speech+1

Open-vocabulary Keyword-spotting with Adaptive Instance Normalization

2023-09-13 · Aviv Navon, Aviv Shamsian, Neta Glazer, Gill Hetz 외

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Keyword Spottingspeech-recognition+1

Visual Keyword Spotting with Attention

2021-10-29 · K R Prajwal, Liliane Momeni, Triantafyllos Afouras, Andrew Zisserman

In this paper, we consider the task of spotting spoken keywords in silent video sequences -- also known as visual keyword spotting. To this end, we investigate Transformer-based models that ingest two streams, a visual e…

Lip ReadingVisual Keyword Spotting