paper-with-me

Papers

Encoder-Decoder Neural Architecture Optimization for Keyword Spotting

2021-06-04 · Tong Mo, Bang Liu

Keyword spotting aims to identify specific keyword audio utterances. In recent years, deep convolutional neural networks have been widely utilized in keyword spotting systems. However, their model architectures are mainly based on off-the shelfbackbones such as VGG-Net or ResNet, instead of specially designed for the task. In this paper, we utilize neural architecture search to design convolutional neural network models that can boost the performance of keyword spotting while maintaining an acceptable memory footprint. Specifically, we search the model operators and their connections in a specific search space with Encoder-Decoder neural architecture optimization. Extensive evaluations on Google's Speech Commands Dataset show that the model architecture searched by our approach achieves a state-of-the-art accuracy of over 97%.

📄 PDF Abstract BibTeX arXiv:2106.02738

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderKeyword SpottingNeural Architecture Search

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Residual Connection 설명 없음
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Kaiming Initialization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Learning To Detect Keyword Parts And Whole By Smoothed Max Pooling

2020-01-25 · Hyun-Jin Park, Patrick Violette, Niranjan Subrahmanya

We propose smoothed max pooling loss and its application to keyword spotting systems. The proposed approach jointly trains an encoder (to detect keyword parts) and a decoder (to detect whole keyword) in a semi-supervised…

DecoderKeyword Spottingspeech-recognitionSpeech Recognition

Keyword Transformer: A Self-Attention Model for Keyword Spotting

2021-04-01 · Axel Berg, Mark O'Connor, Miguel Tairum Cruz

The Transformer architecture has been successful across many domains, including natural language processing, computer vision and speech recognition. In keyword spotting, self-attention has primarily been used on top of c…

Keyword SpottingSpeech Recognition

Multi-task Learning with Cross Attention for Keyword Spotting

2021-07-15 · Takuya Higuchi, Anmol Gupta, Chandra Dhir

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKeyword Spotting+4

Zero-shot keyword spotting for visual speech recognition in-the-wild

2018-07-23 · ECCV 2018 9 · Themos Stafylakis, Georgios Tzimiropoulos

Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, p…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKeyword Spotting+4

Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric

2020-11-02 · Ashish Shrivastava, Arnav Kundu, Chandra Dhir, Devang Naik 외

Deep Neural Network--Hidden Markov Model (DNN-HMM) based methods have been successfully used for many always-on keyword spotting algorithms that detect a wake word to trigger a device. The DNN predicts the state probabil…

DecoderKeyword Spotting