paper-with-me

홈 › Papers

Spike-Triggered Contextual Biasing for End-to-End Mandarin Speech Recognition

2023-10-07 · Kaixun Huang, Ao Zhang, BinBin Zhang, Tianyi Xu, Xingchen Song, Lei Xie

The attention-based deep contextual biasing method has been demonstrated to effectively improve the recognition performance of end-to-end automatic speech recognition (ASR) systems on given contextual phrases. However, unlike shallow fusion methods that directly bias the posterior of the ASR model, deep biasing methods implicitly integrate contextual information, making it challenging to control the degree of bias. In this study, we introduce a spike-triggered deep biasing method that simultaneously supports both explicit and implicit bias. Moreover, both bias approaches exhibit significant improvements and can be cascaded with shallow fusion methods for better results. Furthermore, we propose a context sampling enhancement strategy and improve the contextual phrase filtering algorithm. Experiments on the public WenetSpeech Mandarin biased-word dataset show a 32.0% relative CER reduction compared to the baseline model, with an impressively 68.6% relative CER reduction on contextual phrases.

📄 PDF Abstract BibTeX arXiv:2310.04657

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Spike-Triggered Non-Autoregressive Transformer for End-to-End Speech Recognition

2020-05-16 · Zhengkun Tian, Jiangyan Yi, Jian-Hua Tao, Ye Bai 외

Non-autoregressive transformer models have achieved extremely fast inference speed and comparable performance with autoregressive sequence-to-sequence models in neural machine translation. Most of the non-autoregressive …

Machine Translationspeech-recognitionSpeech RecognitionTranslation

CB-Conformer: Contextual biasing Conformer for biased word recognition

2023-04-19 · Yaoxun Xu, Baiji Liu, Qiaochu Huang and, Xingchen Song 외

Due to the mismatch between the source and target domains, how to better utilize the biased word information to improve the performance of the automatic speech recognition model in the target domain becomes a hot researc…

Automatic Speech RecognitionLanguage ModelingLanguage Modellingspeech-recognition+1

Automatic Text Pronunciation Correlation Generation and Application for Contextual Biasing

2025-01-01 · Gaofeng Cheng, Haitian Lu, Chengxu Yang, Xuyang Wang 외

Effectively distinguishing the pronunciation correlations between different written texts is a significant issue in linguistic acoustics. Traditionally, such pronunciation correlations are obtained through manually desig…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition

Non-autoregressive Mandarin-English Code-switching Speech Recognition

2021-04-06 · Shun-Po Chuang, Heng-Jui Chang, Sung-Feng Huang, Hung-Yi Lee

Mandarin-English code-switching (CS) is frequently used among East and Southeast Asian people. However, the intra-sentence language switching of the two very different languages makes recognizing CS speech challenging. M…

DecoderSentencespeech-recognitionSpeech Recognition

Text Injection for Neural Contextual Biasing

2024-06-05 · Zhong Meng, Zelin Wu, Rohit Prabhavalkar, Cal Peyser 외

Neural contextual biasing effectively improves automatic speech recognition (ASR) for crucial phrases within a speaker's context, particularly those that are infrequent in the training data. This work proposes contextual…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition