paper-with-me

홈 › Papers

LM-assisted keyword biasing with Aho-Corasick algorithm for Transducer-based ASR

2024-09-20 · Iuliia Thorbecke, Juan Zuluaga-Gomez, Esaú Villatoro-Tello, Andres Carofilis, Shashi Kumar, Petr Motlicek, Karthik Pandia, Aravind Ganapathiraju

Despite the recent success of end-to-end models for automatic speech recognition, recognizing special rare and out-of-vocabulary words, as well as fast domain adaptation with text, are still challenging. It often happens that biasing to the special entities leads to a degradation in the overall performance. We propose a light on-the-fly method to improve automatic speech recognition performance by combining a bias list of named entities with a word-level n-gram language model with the shallow fusion approach based on the Aho-Corasick string matching algorithm. The Aho-Corasick algorithm has proved to be more efficient than other methods and allows fast context adaptation. An n-gram language model is introduced as a graph with fail and output arcs, where the arc weights are adapted from the n-gram probabilities. The language model is used as an additional support to keyword biasing when the language model is combined with bias entities in a single context graph to take care of the overall performance. We demonstrate our findings on 4 languages, 2 public and 1 private datasets including performance on named entities and out-of-vocabulary entities. We achieve up to 21.6% relative improvement in the general word error rate with no practical difference in the inverse real-time factor.

📄 PDF Abstract BibTeX arXiv:2409.13514

Code (0)

등록된 구현이 없습니다.

Tasks

ARCAutomatic Speech RecognitionDomain AdaptationLanguage ModelingLanguage Modellingspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Models

2017-10-26 · Yanzhang He, Rohit Prabhavalkar, Kanishka Rao, Wei Li 외

We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly learns acoustic and language model comp…

General ClassificationKeyword SpottingLanguage ModelingLanguage Modelling+1

Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter

2024-06-11 · Andrei Andrusenko, Aleksandr Laptev, Vladimir Bataev, Vitaly Lavrukhin 외

Accurate recognition of rare and new words remains a pressing problem for contextualized Automatic Speech Recognition (ASR) systems. Most context-biasing methods involve modification of the ASR model or the beam-search d…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

2024-03-20 · Yu Xi, Hao Li, Baochen Yang, Haoyu Li 외

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically f…

Keyword Spotting

Improving Large-scale Deep Biasing with Phoneme Features and Text-only Data in Streaming Transducer

2023-11-15 · Jin Qiu, Lu Huang, Boyu Li, Jun Zhang 외

Deep biasing for the Transducer can improve the recognition performance of rare words or contextual entities, which is essential in practical applications, especially for streaming Automatic Speech Recognition (ASR). How…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Contextual Biasing with the Knuth-Morris-Pratt Matching Algorithm

2023-09-29 · Weiran Wang, Zelin Wu, Diamantino Caseiro, Tsendsuren Munkhdalai 외

Contextual biasing refers to the problem of biasing the automatic speech recognition (ASR) systems towards rare entities that are relevant to the specific user or application scenarios. We propose algorithms for contextu…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition