paper-with-me

홈 › Papers

Deep context: end-to-end contextual speech recognition

2018-08-07 · Golan Pundak, Tara N. Sainath, Rohit Prabhavalkar, Anjuli Kannan, Ding Zhao

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-end (E2E) ASR sys- tem that utilizes such context. Our approach, which we re- fer to as Contextual Listen, Attend and Spell (CLAS) jointly- optimizes the ASR components along with embeddings of the context n-grams. During inference, the CLAS system can be presented with context phrases which might contain out-of- vocabulary (OOV) terms not seen during training. We com- pare our proposed system to a more traditional contextualiza- tion approach, which performs shallow-fusion between inde- pendently trained LAS and contextual n-gram models during beam search. Across a number of tasks, we find that the pro- posed CLAS system outperforms the baseline method by as much as 68% relative WER, indicating the advantage of joint optimization over individually trained components. Index Terms: speech recognition, sequence-to-sequence models, listen attend and spell, LAS, attention, embedded speech recognition.

📄 PDF Abstract BibTeX arXiv:1808.02480

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network

2023-05-21 · Kaixun Huang, Ao Zhang, Zhanheng Yang, Pengcheng Guo 외

Contextual information plays a crucial role in speech recognition technologies and incorporating it into the end-to-end speech recognition models has drawn immense interest recently. However, previous deep bias methods l…

speech-recognitionSpeech Recognition

An efficient text augmentation approach for contextualized Mandarin speech recognition

2024-06-14 · Naijun Zheng, Xucheng Wan, Kai Liu, Ziqing Du 외

Although contextualized automatic speech recognition (ASR) systems are commonly used to improve the recognition of uncommon words, their effectiveness is hindered by the inherent limitations of speech-text data availabil…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

Speech-Aware Long Context Pruning and Integration for Contextualized Automatic Speech Recognition

2025-11-14 · Yiming Rong, Yixin Zhang, Ziyi Wang, Deyang Jiang 외 arxiv

Automatic speech recognition (ASR) systems have achieved remarkable performance in common conditions but often struggle to leverage long-context information in contextualized scenarios that require domain-specific knowle…

Speech Recognition

Contextualized Automatic Speech Recognition with Dynamic Vocabulary Prediction and Activation

2025-05-29 · Zhennan Lin, Kaixun Huang, Wei Ren, Linju Yang 외

Deep biasing improves automatic speech recognition (ASR) performance by incorporating contextual phrases. However, most existing methods enhance subwords in a contextual phrase as independent units, potentially compromis…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Attention-based Contextual Language Model Adaptation for Speech Recognition

2021-06-02 · Findings (ACL) 2021 8 · Richard Diehl Martinez, Scott Novotney, Ivan Bulyko, Ariya Rastrow 외

Language modeling (LM) for automatic speech recognition (ASR) does not usually incorporate utterance level contextual information. For some domains like voice assistants, however, additional context, such as the time at …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2