paper-with-me

Papers

Small Footprint Convolutional Recurrent Networks for Streaming Wakeword Detection

2020-11-25 · Mohammad Omar Khursheed, Christin Jose, Rajath Kumar, GengShen Fu, Brian Kulis, Santosh Kumar Cheekatmalla

In this work, we propose small footprint Convolutional Recurrent Neural Network models applied to the problem of wakeword detection and augment them with scaled dot product attention. We find that false accepts compared to Convolutional Neural Network models in a 250k parameter budget can be reduced by 25% with a 10% reduction in parameter size by using CRNNs, and we can get up to 32% improvement at a 50k parameter budget with 75% reduction in parameter size compared to word-level Dense Neural Network models. We discuss solutions to the challenging problem of performing inference on streaming audio with CRNNs, as well as differences in start-end index errors and latency in comparison to CNN, DNN, and DNN-HMM models.

📄 PDF Abstract BibTeX arXiv:2011.12941

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Tiny-CRNN: Streaming Wakeword Detection In A Low Footprint Setting

2021-09-29 · Mohammad Omar Khursheed, Christin Jose, Rajath Kumar, GengShen Fu 외

In this work, we propose Tiny-CRNN (Tiny Convolutional Recurrent Neural Network) models applied to the problem of wakeword detection, and augment them with scaled dot product attention. We find that, compared to Convolut…

RepCNN: Micro-sized, Mighty Models for Wakeword Detection

2024-06-04 · Arnav Kundu, Prateeth Nayak, Priyanka Padmanabhan, Devang Naik

Always-on machine learning models require a very low memory and compute footprint. Their restricted parameter count limits the model's capacity to learn, and the effectiveness of the usual training algorithms to find the…

Keyword Spotting

ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition

2022-09-29 · Martin Radfar, Rohit Barnwal, Rupak Vignesh Swaminathan, Feng-Ju Chang 외

The recurrent neural network transducer (RNN-T) is a prominent streaming end-to-end (E2E) ASR technology. In RNN-T, the acoustic encoder commonly consists of stacks of LSTMs. Very recently, as an alternative to LSTM laye…

speech-recognitionSpeech Recognition

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

2017-03-15 · Sercan O. Arik, Markus Kliegl, Rewon Child, Joel Hestness 외

Keyword spotting (KWS) constitutes a major component of human-technology interfaces. Maximizing the detection accuracy at a low false alarm (FA) rate, while minimizing the footprint size, latency and complexity are the g…

Keyword SpottingSmall-Footprint Keyword Spottingspeech-recognitionSpeech Recognition

DONUT: CTC-based Query-by-Example Keyword Spotting

2018-10-22 · NIPS Workshop IRASL 2018 · Anonymous

Keyword spotting—or wakeword detection—is an essential feature for hands-free operation of modern voice-controlled devices. With such devices becoming ubiquitous, users might want to choose a personalized custom wakeword…

Keyword Spotting