paper-with-me

Papers

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

2024-03-20 · Yu Xi, Hao Li, Baochen Yang, Haoyu Li, Hainan Xu, Kai Yu

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically follow a frame-synchronous approach, where search decisions are made repeatedly at each frame despite the fact that most frames are keyword-irrelevant. In this paper, we propose TDT-KWS, which leverages token-and-duration Transducers (TDT) for KWS tasks. We also propose a novel KWS task-specific decoding algorithm for Transducer-based models, which supports highly effective frame-asynchronous keyword search in streaming speech scenarios. With evaluations conducted on both the public Hey Snips and self-constructed LibriKWS-20 datasets, our proposed KWS-decoding algorithm produces more accurate results than conventional ASR decoding algorithms. Additionally, TDT-KWS achieves on-par or better wake word detection performance than both RNN-T and traditional TDT-ASR systems while achieving significant inference speed-up. Furthermore, experiments show that TDT-KWS is more robust to noisy environments compared to RNN-T KWS.

📄 PDF Abstract BibTeX arXiv:2403.13332

Code (1)

x-lance/kwstreamingsearch pytorch

Tasks

Keyword Spotting

Similar Papers 제목 키워드 기반

Bridging the Gap between Audio and Text using Parallel-attention for User-defined Keyword Spotting

2024-08-07 · Youkyum Kim, Jaemin Jung, Jihwan Park, Byeong-Yeol Kim 외

This paper proposes a novel user-defined keyword spotting framework that accurately detects audio keywords based on text enrollment. Since audio data possesses additional acoustic information compared to text, there are …

Keyword Spotting

MFA-KWS: Effective Keyword Spotting with Multi-head Frame-asynchronous Decoding

2025-05-26 · Yu Xi, Haoyu Li, Xiaoyu Gu, Yidi Jiang 외

Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explore the entire search space without explic…

Keyword Spotting

Exploring Sequence-to-Sequence Transformer-Transducer Models for Keyword Spotting

2022-11-11 · Beltrán Labrador, Guanlong Zhao, Ignacio López Moreno, Angelo Scorza Scarpati 외

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a s…

Keyword Spotting

Fast ASR-free and almost zero-resource keyword spotting using DTW and CNNs for humanitarian monitoring

2018-06-25 · Raghav Menon, Herman Kamper, John Quinn, Thomas Niesler

We use dynamic time warping (DTW) as supervision for training a convolutional neural network (CNN) based keyword spotting system using a small set of spoken isolated keywords. The aim is to allow rapid deployment of a ke…

Dynamic Time WarpingHumanitarianKeyword SpottingTemplate Matching

ASR-free CNN-DTW keyword spotting using multilingual bottleneck features for almost zero-resource languages

2018-07-23 · Raghav Menon, Herman Kamper, Emre Yilmaz, John Quinn 외

We consider multilingual bottleneck features (BNFs) for nearly zero-resource keyword spotting. This forms part of a United Nations effort using keyword spotting to support humanitarian relief programmes in parts of Afric…

Dynamic Time WarpingHumanitarianKeyword SpottingTemplate Matching