paper-with-me

홈 › Papers

A Parallelizable Lattice Rescoring Strategy with Neural Language Models

2021-03-08 · Ke Li, Daniel Povey, Sanjeev Khudanpur

This paper proposes a parallel computation strategy and a posterior-based lattice expansion algorithm for efficient lattice rescoring with neural language models (LMs) for automatic speech recognition. First, lattices from first-pass decoding are expanded by the proposed posterior-based lattice expansion algorithm. Second, each expanded lattice is converted into a minimal list of hypotheses that covers every arc. Each hypothesis is constrained to be the best path for at least one arc it includes. For each lattice, the neural LM scores of the minimal list are computed in parallel and are then integrated back to the lattice in the rescoring stage. Experiments on the Switchboard dataset show that the proposed rescoring strategy obtains comparable recognition performance and generates more compact lattices than a competitive baseline method. Furthermore, the parallel rescoring method offers more flexibility by simplifying the integration of PyTorch-trained neural LMs for lattice rescoring with Kaldi.

📄 PDF Abstract BibTeX arXiv:2103.05081

Code (1)

kaldi-asr/kaldi 공식 구현

Tasks

ARCAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Lattice Rescoring Strategies for Long Short Term Memory Language Models in Speech Recognition

2017-11-15 · Shankar Kumar, Michael Nirschl, Daniel Holtmann-Rice, Hank Liao 외

Recurrent neural network (RNN) language models (LMs) and Long Short Term Memory (LSTM) LMs, a variant of RNN LMs, have been shown to outperform traditional N-gram LMs on speech recognition tasks. However, these models ar…

speech-recognitionSpeech Recognition

LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

2021-04-06 · Anton Mitrofanov, Mariya Korenevskaya, Ivan Podluzhny, Yuri Khokhlov 외

Neural network-based language models are commonly used in rescoring approaches to improve the quality of modern automatic speech recognition (ASR) systems. Most of the existing methods are computationally expensive since…

ARCAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Modeling+3

Lattention: Lattice-attention in ASR rescoring

2021-11-19 · Prabhat Pandey, Sergio Duarte Torres, Ali Orkan Bayer, Ankur Gandhe 외

Lattices form a compact representation of multiple hypotheses generated from an automatic speech recognition system and have been shown to improve performance of downstream tasks like spoken language understanding and sp…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognition+3

Lattice Rescoring Based on Large Ensemble of Complementary Neural Language Models

2023-12-20 · Atsunori Ogawa, Naohiro Tawara, Marc Delcroix, Shoko Araki

We investigate the effectiveness of using a large ensemble of advanced neural language models (NLMs) for lattice rescoring on automatic speech recognition (ASR) hypotheses. Previous studies have reported the effectivenes…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Contextualizing ASR Lattice Rescoring with Hybrid Pointer Network Language Model

2020-05-15 · Da-Rong Liu, Chunxi Liu, Frank Zhang, Gabriel Synnaeve 외

Videos uploaded on social media are often accompanied with textual descriptions. In building automatic speech recognition (ASR) systems for videos, we can exploit the contextual information provided by such video metadat…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2