Exploring Representation Learning for Small-Footprint Keyword Spotting

2023-03-20 · Fan Cui, Liyong Guo, Quandong Wang, Peng Gao, Yujun Wang

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore representation learning for KWS by self-supervised contrastive learning and self-training with pretrained model. First, local-global contrastive siamese networks (LGCSiam) are designed to learn similar utterance-level representations for similar audio samplers by proposed local-global contrastive loss without requiring ground-truth. Second, a self-supervised pretrained Wav2Vec 2.0 model is applied as a constraint module (WVC) to force the KWS model to learn frame-level acoustic representations. By the LGCSiam and WVC modules, the proposed small-footprint KWS model can be pretrained with unlabeled data. Experiments on speech commands dataset show that the self-training WVC module and the self-supervised LGCSiam module significantly improve accuracy, especially in the case of training on a small labeled dataset.

📄 PDF Abstract BibTeX arXiv:2303.10912

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning Keyword Spotting Representation LearningSmall-Footprint Keyword Spotting

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Low-bit quantization and quantization-aware training for small-footprint keyword spotting

2018-10-19 · Yuriy Mishchenko, Yusuf Goren, Ming Sun, Chris Beauchene 외

We investigate low-bit quantization to reduce computational cost of deep neural network (DNN) based keyword spotting (KWS). We propose approaches to further reduce quantization bits via integrating quantization into keyw…

Keyword Spotting Quantization Small-Footprint Keyword Spotting

Improving Small Footprint Few-shot Keyword Spotting with Supervision on Auxiliary Data

2023-08-31 · Seunghan Yang, Byeonggeun Kim, Kyuhong Shim, Simyung Chang

Few-shot keyword spotting (FS-KWS) models usually require large-scale annotated datasets to generalize to unseen target keywords. However, existing KWS datasets are limited in scale and gathering keyword-like labeled dat…

Keyword Spotting Multi-Task Learning Self-Supervised Learning

Deep Residual Learning for Small-Footprint Keyword Spotting

2017-10-28 · Raphael Tang, Jimmy Lin

We explore the application of deep residual learning and dilated convolutions to the keyword spotting task, using the recently-released Google Speech Commands Dataset as our benchmark. Our best residual network (ResNet) …

Keyword Spotting Small-Footprint Keyword Spotting

Neural ODE with Temporal Convolution and Time Delay Neural Networks for Small-Footprint Keyword Spotting

2020-08-01 · Hiroshi Fuketa, Yukinori Morita

In this paper, we propose neural network models based on the neural ordinary differential equation (NODE) for small-footprint keyword spotting (KWS). We present techniques to apply NODE to KWS that make it possible to ad…

Keyword Spotting Small-Footprint Keyword Spotting

Small-footprint Keyword Spotting Using Deep Neural Network and Connectionist Temporal Classifier

2017-09-12 · Zhiming Wang, Xiaolong Li, Jun Zhou

Mainly for the sake of solving the lack of keyword-specific data, we propose one Keyword Spotting (KWS) system using Deep Neural Network (DNN) and Connectionist Temporal Classifier (CTC) on power-constrained small-footpr…

Decision Making Keyword Spotting Small-Footprint Keyword Spotting speech-recognition+1