Predicting detection filters for small footprint open-vocabulary keyword spotting
In this paper, we propose a fully-neural approach to open-vocabulary keyword spotting, that allows the users to include a customizable voice interface to their device and that does not require task-specific data. We present a keyword detection neural network weighing less than 250KB, in which the topmost layer performing keyword detection is predicted by an auxiliary network, that may be run offline to generate a detector for any keyword. We show that the proposed model outperforms acoustic keyword spotting baselines by a large margin on two tasks of detecting keywords in utterances and three tasks of detecting isolated speech commands. We also propose a method to fine-tune the model when specific training data is available for some keywords, which yields a performance similar to a standard speech command neural network while keeping the ability of the model to be applied to new keywords.
Code (0)
등록된 구현이 없습니다.
Tasks
Keyword SpottingSimilar Papers 제목 키워드 기반
Keyword Spotting with Hyper-Matched Filters for Small Footprint Devices
Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyw…
Keyword SpottingDecomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completion
RGB-guided depth completion aims at predicting dense depth maps from sparse depth measurements and corresponding RGB images, where how to effectively and efficiently exploit the multi-modal information is a key issue. Gu…
Depth Completionobject-detectionObject DetectionRGB-D Salient Object Detection+1Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networks
We explore a keyword-based spoken language understanding system, in which the intent of the user can directly be derived from the detection of a sequence of keywords in the query. In this paper, we focus on an open-vocab…
Keyword SpottingSpoken Language UnderstandingSmall-Footprint Keyword Spotting with Multi-Scale Temporal Convolution
Keyword Spotting (KWS) plays a vital role in human-computer interaction for smart on-device terminals and service robots. It remains challenging to achieve the trade-off between small footprint and high accuracy for KWS …
Efficient Neural NetworkKeyword SpottingSmall-Footprint Keyword SpottingMaskBEV: Joint Object Detection and Footprint Completion for Bird's-eye View 3D Point Clouds
Recent works in object detection in LiDAR point clouds mostly focus on predicting bounding boxes around objects. This prediction is commonly achieved using anchor-based or anchor-free detectors that predict bounding boxe…
Objectobject-detectionObject Detection