paper-with-me

홈 › Papers

Hello Edge: Keyword Spotting on Microcontrollers

2017-11-20 · Yundong Zhang, Naveen Suda, Liangzhen Lai, Vikas Chandra

Keyword spotting (KWS) is a critical component for enabling speech based user interactions on smart devices. It requires real-time response and high accuracy for good user experience. Recently, neural networks have become an attractive choice for KWS architecture because of their superior accuracy compared to traditional speech processing algorithms. Due to its always-on nature, KWS application has highly constrained power budget and typically runs on tiny microcontrollers with limited memory and compute capability. The design of neural network architecture for KWS must consider these constraints. In this work, we perform neural network architecture evaluation and exploration for running KWS on resource-constrained microcontrollers. We train various neural network architectures for keyword spotting published in literature to compare their accuracy and memory/compute requirements. We show that it is possible to optimize these neural network architectures to fit within the memory and compute constraints of microcontrollers without sacrificing accuracy. We further explore the depthwise separable convolutional neural network (DS-CNN) and compare it against other neural network architectures. DS-CNN achieves an accuracy of 95.4%, which is ~10% higher than the DNN model with similar number of parameters.

📄 PDF Abstract BibTeX arXiv:1711.07128

Code (18)

ARM-software/ML-KWS-for-MCU 공식 구현 tf
Anustup900/Tensorflow-Speech-Recognition tf
BgLoveXixi/Keyword_recognition tf
FraCorti/Deep_Subnetworks_for_Dynamic_Resource_Constraints tf
Jaskaran197/KWS-TF-MCU tf
Lebhoryi/ML-KWS-for-MCU tf
Paulonso/ARM-software tf
Paulonso/ML-KWS-for-MCU tf
UT2UH/ML-KWS-for-ESP32 tf
etrommer/dcsr tf
fracorti/reds tf
google-research/google-research/tree/master/kws_streaming tf
hustxsl/C-ML-KWS-for-MCU tf
jayant766/MIDAS-IIITD tf
magahub/KWS-ARM tf
mindspore-ai/models/tree/master/research/nlp/dscnn mindspore
robin-ai-ml/ML-KWS-for-MCU tf
widzemin/audio_project tf

Tasks

Keyword Spotting

Methods 이 논문이 사용한 방법론

Flight Expidia cancel ticket help 설명 없음
Dilated Convolution 설명 없음
Batch Normalization 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

On-Device Domain Learning for Keyword Spotting on Low-Power Extreme Edge Embedded Systems

2024-03-12 · Cristian Cioflan, Lukas Cavigelli, Manuele Rusci, Miguel de Prado 외

Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensur…

Domain AdaptationKeyword Spotting

Keyword Spotting System and Evaluation of Pruning and Quantization Methods on Low-power Edge Microcontrollers

2022-08-04 · Jingyi Wang, Shengchen Li

Keyword spotting (KWS) is beneficial for voice-based user interactions with low-power devices at the edge. The edge devices are usually always-on, so edge computing brings bandwidth savings and privacy protection. The de…

Edge-computingKeyword SpottingQuantization

LiCo-Net: Linearized Convolution Network for Hardware-efficient Keyword Spotting

2022-11-09 · Haichuan Yang, Zhaojun Yang, Li Wan, Biqiao Zhang 외

This paper proposes a hardware-efficient architecture, Linearized Convolution Network (LiCo-Net) for keyword spotting. It is optimized specifically for low-power processor units like microcontrollers. ML operators exhibi…

Keyword Spotting

End-to-End Efficiency in Keyword Spotting: A System-Level Approach for Embedded Microcontrollers

2025-09-08 · Pietro Bartoli, Tommaso Bondini, Christian Veronesi, Andrea Giudici 외 arxiv

Keyword spotting (KWS) is a key enabling technology for hands-free interaction in embedded and IoT devices, where stringent memory and energy constraints challenge the deployment of AI-enabeld devices. In this work, we s…

Keyword Spotting

On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation

2023-07-06 · Gene-Ping Yang, Yue Gu, Qingming Tang, Dongsu Du 외

Large self-supervised models are effective feature extractors, but their application is challenging under on-device budget constraints and biased dataset collection, especially in keyword spotting. To address this, we pr…

Keyword SpottingKnowledge DistillationRepresentation LearningSpeech Representation Learning