Effective Combination of DenseNet andBiLSTM for Keyword Spotting
Keyword spotting (KWS) is a major component of human–computer interaction for smarton-device terminals and service robots, the purpose of which is to maximize the detection accuracy whilekeeping footprint size small. In this paper, based on the powerful ability of DenseNet on extracting localfeature-maps, we propose a new network architecture (DenseNet-BiLSTM) for KWS. In our DenseNet-BiLSTM, the DenseNet is primarily applied to obtain local features, while the BiLSTM is used to grabtime series features. In general, the DenseNet is used in computer vision tasks, and it may corrupt contextualinformation for speech audios. In order to make DenseNet suitable for KWS, we propose a variant DenseNet,called DenseNet-Speech, which removes the pool on the time dimension in transition layers to preservespeech time series information. In addition, our DenseNet-Speech uses less dense blocks and filters to keepthe model small, thereby reducing time consumption for mobile devices. The experimental results show thatfeature-maps from DenseNet-Speech maintain time series information well. Our method outperforms thestate-of-the-art methods in terms of accuracy on Google Speech Commands dataset. DenseNet-BiLSTM isable to achieve the accuracy of 96.6% for the 20-commands recognition task with 223K trainable parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Keyword SpottingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Prototypical Metric Transfer Learning for Continuous Speech Keyword Spotting With Limited Training Data
Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spottin…
General Classificationimbalanced classificationKeyword SpottingTransfer LearningA Channel-Pruned and Weight-Binarized Convolutional Neural Network for Keyword Spotting
We study channel number reduction in combination with weight binarization (1-bit weight precision) to trim a convolutional neural network for a keyword spotting (classification) task. We adopt a group-wise splitting meth…
BinarizationGeneral ClassificationKeyword SpottingToward noise-robust whisper keyword spotting on headphones with in-earcup microphone and curriculum learning
The expanding feature set of modern headphones puts a challenge on the design of their control interface. Users may want to separately control each feature or quickly switch between modes that activate different features…
Keyword SpottingOn the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting
User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many…
Few-Shot LearningKeyword SpottingMeta-LearningSelf-Supervised LearningOpen-vocabulary Keyword-spotting with Adaptive Instance Normalization
Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map th…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Keyword Spottingspeech-recognition+1