paper-with-me

Papers

ed-cec: improving rare word recognition using asr postprocessing based on error detection and context-aware error correction

2023-10-08 · Jiajun He, Zekun Yang, Tomoki Toda

Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text summarization. To address this challenge, we present a novel ASR postprocessing method that focuses on improving the recognition of rare words through error detection and context-aware error correction. Our method optimizes the decoding process by targeting only the predicted error positions, minimizing unnecessary computations. Moreover, we leverage a rare word list to provide additional contextual knowledge, enabling the model to better correct rare words. Experimental results across five datasets demonstrate that our proposed method achieves significantly lower word error rates (WERs) than previous approaches while maintaining a reasonable inference speed. Furthermore, our approach exhibits promising robustness across different ASR systems.

📄 PDF Abstract BibTeX arXiv:2310.05129

Code (1)

Tushar-ml/ED-CEC pytorch

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Intent DetectionKeyword Spottingspeech-recognitionSpeech RecognitionText Summarization

Similar Papers 제목 키워드 기반

An Analysis of BPE Vocabulary Trimming in Neural Machine Translation

2024-03-30 · Marco Cognetta, Tatsuya Hiraoka, Naoaki Okazaki, Rico Sennrich 외

We explore threshold vocabulary trimming in Byte-Pair Encoding subword tokenization, a postprocessing step that replaces rare subwords with their component subwords. The technique is available in popular tokenization lib…

Machine TranslationTranslation

Understanding Zero-shot Rare Word Recognition Improvements Through LLM Integration

2025-02-22 · Haoxuan Wang

In this study, we investigate the integration of a large language model (LLM) with an automatic speech recognition (ASR) system, specifically focusing on enhancing rare word recognition performance. Using a 190,000-hour …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+3

Multi-task Language Modeling for Improving Speech Recognition of Rare Words

2020-11-23 · Chao-Han Huck Yang, Linda Liu, Ankur Gandhe, Yile Gu 외

End-to-end automatic speech recognition (ASR) systems are increasingly popular due to their relative architectural simplicity and competitive performance. However, even though the average accuracy of these systems may be…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+3

Improving Large-scale Deep Biasing with Phoneme Features and Text-only Data in Streaming Transducer

2023-11-15 · Jin Qiu, Lu Huang, Boyu Li, Jun Zhang 외

Deep biasing for the Transducer can improve the recognition performance of rare words or contextual entities, which is essential in practical applications, especially for streaming Automatic Speech Recognition (ASR). How…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Efficient Trie-based Biasing using K-step Prediction for Rare Word Recognition

2025-09-11 · Chin Yuen Kwok, Jia Qi yip arxiv

Contextual biasing improves rare word recognition of ASR models by prioritizing the output of rare words during decoding. A common approach is Trie-based biasing, which gives "bonus scores" to partial hypothesis (e.g. "B…