On-Device Domain Learning for Keyword Spotting on Low-Power Extreme Edge Embedded Systems
Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensure that the adaptation process happens entirely on the edge device. In this work, we propose a fully on-device domain adaptation system achieving up to 14% accuracy gains over already-robust keyword spotting models. We enable on-device learning with less than 10 kB of memory, using only 100 labeled utterances to recover 5% accuracy after adapting to the complex speech noise. We demonstrate that domain adaptation can be achieved on ultra-low-power microcontrollers with as little as 806 mJ in only 14 s on always-on, battery-operated devices.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationKeyword SpottingSimilar Papers 제목 키워드 기반
Towards On-device Domain Adaptation for Noise-Robust Keyword Spotting
The accuracy of a keyword spotting model deployed on embedded devices often degrades when the system is exposed to real environments with significant noise. In this paper, we explore a methodology for tailoring a model t…
Edge-computingKeyword SpottingMicro-power spoken keyword spotting on Xylo Audio 2
For many years, designs for "Neuromorphic" or brain-like processors have been motivated by achieving extreme energy efficiency, compared with von-Neumann and tensor processor devices. As part of their design language, Ne…
Keyword SpottingHow Tiny Can Analog Filterbank Features Be Made for Ultra-low-power On-device Keyword Spotting?
Analog feature extraction is a power-efficient and re-emerging signal processing paradigm for implementing the front-end feature extractor in on device keyword-spotting systems. Despite its power efficiency and re-emerge…
Keyword SpottingAraSpot: Arabic Spoken Command Spotting
Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunti…
Data AugmentationKeyword SpottingSynthetic Data Generationtext-to-speech+1Self-Learning for Personalized Keyword Spotting on Ultra-Low-Power Audio Sensors
This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of…
Keyword SpottingSelf-Learning