paper-with-me

Papers

Multi-task Learning for Voice Trigger Detection

2020-01-26 · Siddharth Sigtia, Pascal Clark, Rob Haynes, Hywel Richards, John Bridle

We describe the design of a voice trigger detection system for smart speakers. In this study, we address two major challenges. The first is that the detectors are deployed in complex acoustic environments with external noise and loud playback by the device itself. Secondly, collecting training examples for a specific keyword or trigger phrase is challenging resulting in a scarcity of trigger phrase specific training data. We describe a two-stage cascaded architecture where a low-power detector is always running and listening for the trigger phrase. If a detection is made at this stage, the candidate audio segment is re-scored by larger, more complex models to verify that the segment contains the trigger phrase. In this study, we focus our attention on the architecture and design of these second-pass detectors. We start by training a general acoustic model that produces phonetic transcriptions given a large labelled training dataset. Next, we collect a much smaller dataset of examples that are challenging for the baseline system. We then use multi-task learning to train a model to simultaneously produce accurate phonetic transcriptions on the larger dataset \emph{and} discriminate between true and easily confusable examples using the smaller dataset. Our results demonstrate that the proposed model reduces errors by half compared to the baseline in a range of challenging test conditions \emph{without} requiring extra parameters.

📄 PDF Abstract BibTeX arXiv:2001.09519

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Improving Voice Trigger Detection with Metric Learning

2022-04-05 · Prateeth Nayak, Takuya Higuchi, Anmol Gupta, Shivesh Ranjan 외

Voice trigger detection is an important task, which enables activating a voice assistant when a target user speaks a keyword phrase. A detector is typically trained on speech data independent of speaker information and u…

DecoderMetric Learning

Streaming Transformer for Hardware Efficient Voice Trigger Detection and False Trigger Mitigation

2021-05-14 · Vineet Garg, Wonil Chang, Siddharth Sigtia, Saurabh Adya 외

We present a unified and hardware efficient architecture for two stage voice trigger detection (VTD) and false trigger mitigation (FTM) tasks. Two stage VTD systems of voice assistants can get falsely activated to audio …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Progressive Voice Trigger Detection: Accuracy vs Latency

2020-10-29 · Siddharth Sigtia, John Bridle, Hywel Richards, Pascal Clark 외

We present an architecture for voice trigger detection for virtual assistants. The main idea in this work is to exploit information in words that immediately follow the trigger phrase. We first demonstrate that by includ…

Voice trigger detection from LVCSR hypothesis lattices using bidirectional lattice recurrent neural networks

2020-02-29 · Woojay Jeon, Leo Liu, Henry Mason

We propose a method to reduce false voice triggers of a speech-enabled personal assistant by post-processing the hypothesis lattice of a server-side large-vocabulary continuous speech recognizer (LVCSR) via a neural netw…

The NPU System for the 2020 Personalized Voice Trigger Challenge

2021-02-26 · Jingyong Hou, Li Zhang, Yihui Fu, Qing Wang 외

This paper describes the system developed by the NPU team for the 2020 personalized voice trigger challenge. Our submitted system consists of two independently trained subsystems: a small footprint keyword spotting (KWS)…

Keyword SpottingSmall-Footprint Keyword SpottingSpeaker Verification