paper-with-me

Papers

BBS-KWS:The Mandarin Keyword Spotting System Won the Video Keyword Wakeup Challenge

2021-12-03 · Yuting Yang, Binbin Du, Yingxin Zhang, Wenxuan Wang, Yuke Li

This paper introduces the system submitted by the Yidun NISP team to the video keyword wakeup challenge. We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model, a keyword biasing (B) mechanism and the introduction of syllable modeling units (S). By considering this, we term the total system BBS-KWS as an abbreviation. The BBS-KWS system consists of an end-to-end automatic speech recognition (ASR) module and a KWS module. The ASR module converts speech features to text representations, which applies a big backbone network to the acoustic model and takes syllable modeling units into consideration as well. In addition, the keyword biasing mechanism is used to improve the recall rate of keywords in the ASR inference stage. The KWS module applies multiple criteria to determine the absence or presence of the keywords, such as multi-stage matching, fuzzy matching, and connectionist temporal classification (CTC) prefix score. To further improve our system, we conduct semi-supervised learning on the CN-Celeb dataset for better generalization. In the VKW task, the BBS-KWS system achieves significant gains over the baseline and won the first place in two tracks.

📄 PDF Abstract BibTeX arXiv:2112.01757

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Keyword Spottingspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Visual Keyword Spotting with Attention

2021-10-29 · K R Prajwal, Liliane Momeni, Triantafyllos Afouras, Andrew Zisserman

In this paper, we consider the task of spotting spoken keywords in silent video sequences -- also known as visual keyword spotting. To this end, we investigate Transformer-based models that ingest two streams, a visual e…

Lip ReadingVisual Keyword Spotting

Word Searching in Scene Image and Video Frame in Multi-Script Scenario using Dynamic Shape Coding

2017-08-18 · Partha Pratim Roy, Ayan Kumar Bhunia, Avirup Bhattacharyya, Umapada Pal

Retrieval of text information from natural scene images and video frames is a challenging task due to its inherent problems like complex character shapes, low resolution, background noise, etc. Available OCR systems ofte…

Keyword SpottingOptical Character Recognition (OCR)RetrievalText Retrieval

MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

2024-06-11 · Zhiqi Ai, Zhiyong Chen, Shugong Xu

In this paper, we propose MM-KWS, a novel approach to user-defined keyword spotting leveraging multi-modal enrollments of text and speech templates. Unlike previous methods that focus solely on either text or speech feat…

Data AugmentationKeyword Spotting

Few-Shot Keyword Spotting With Prototypical Networks

2020-07-25 · arXiv 2020 6 · Archit Parnami, Minwoo Lee

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learn…

Keyword SpottingMetric Learning

Metric Learning for Keyword Spotting

2020-05-18

The goal of this work is to train effective representations for keyword spotting via metric learning. Most existing works address keyword spotting as a closed-set classification problem, where both target and non-target …

Keyword SpottingMetric Learning