paper-with-me

Papers

Efficient keyword spotting using dilated convolutions and gating

2018-11-19 · Alice Coucke, Mohammed Chlieh, Thibault Gisselbrecht, David Leroy, Mathieu Poumeyrol, Thibaut Lavril

We explore the application of end-to-end stateless temporal modeling to small-footprint keyword spotting as opposed to recurrent networks that model long-term temporal dependencies using internal states. We propose a model inspired by the recent success of dilated convolutions in sequence modeling applications, allowing to train deeper architectures in resource-constrained configurations. Gated activations and residual connections are also added, following a similar configuration to WaveNet. In addition, we apply a custom target labeling that back-propagates loss from specific frames of interest, therefore yielding higher accuracy and only requiring to detect the end of the keyword. Our experimental results show that our model outperforms a max-pooling loss trained recurrent neural network using LSTM cells, with a significant decrease in false rejection rate. The underlying dataset - "Hey Snips" utterances recorded by over 2.2K different speakers - has been made publicly available to establish an open reference for wake-word detection.

📄 PDF Abstract BibTeX arXiv:1811.07684

Code (5)

danFromTelAviv/key_words_spotting pytorch
snipsco/keyword-spotting-research-datasets
snipsco/tract tf
sonos/keyword-spotting-research-datasets
sonos/tract pytorch

Tasks

Keyword SpottingSmall-Footprint Keyword Spotting

Methods 이 논문이 사용한 방법론

Mixture of Logistic Distributions 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Dilated Causal Convolution A Dilated Causal Convolution is a causal convolution where the filter is applied over an area larger than its length by…
WaveNet WaveNet is an audio generative model based on the PixelCNN architecture. In order to deal with long-range temporal dependencies…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Few-Shot Keyword Spotting With Prototypical Networks

2020-07-25 · arXiv 2020 6 · Archit Parnami, Minwoo Lee

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learn…

Keyword SpottingMetric Learning

Deep Residual Learning for Small-Footprint Keyword Spotting

2017-10-28 · Raphael Tang, Jimmy Lin

We explore the application of deep residual learning and dilated convolutions to the keyword spotting task, using the recently-released Google Speech Commands Dataset as our benchmark. Our best residual network (ResNet) …

Keyword SpottingSmall-Footprint Keyword Spotting

WaveSense: Efficient Temporal Convolutions with Spiking Neural Networks for Keyword Spotting

2021-11-02 · Philipp Weidel, Sadique Sheik

Ultra-low power local signal processing is a crucial aspect for edge applications on always-on devices. Neuromorphic processors emulating spiking neural networks show great computational power while fulfilling the limite…

Keyword Spotting

Small-Footprint Keyword Spotting on Raw Audio Data with Sinc-Convolutions

2019-11-05 · Simon Mittermaier, Ludwig Kürzinger, Bernd Waschneck, Gerhard Rigoll

Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also…

Keyword SpottingSmall-Footprint Keyword Spotting

AutoKWS: Keyword Spotting with Differentiable Architecture Search

2020-09-08 · Bo Zhang, Wenfeng Li, Qingyuan Li, Weiji Zhuang 외

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fas…

Keyword SpottingNeural Architecture Search