paper-with-me

홈 › Papers

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

2019-05-16 · Joongbo Shin, Yoonhyung Lee, Kyomin Jung

In automatic speech recognition, many studies have shown performance improvements using language models (LMs). Recent studies have tried to use bidirectional LMs (biLMs) instead of conventional unidirectional LMs (uniLMs) for rescoring the $N$-best list decoded from the acoustic model. In spite of their theoretical benefits, the biLMs have not given notable improvements compared to the uniLMs in their experiments. This is because their biLMs do not consider the interaction between the two directions. In this paper, we propose a novel sentence scoring method considering the interaction between the past and the future words on the biLM. Our experimental results on the LibriSpeech corpus show that the biLM with the proposed sentence scoring outperforms the uniLM for the $N$-best list rescoring, consistently and significantly in all experimental conditions. The analysis of WERs by word position demonstrates that the biLM is more robust than the uniLM especially when a recognized sentence is short or a misrecognized word is at the beginning of the sentence.

📄 PDF Abstract BibTeX arXiv:1905.06655

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage ModellingSentencespeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling

2022-05-25 · Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou 외

Sentence scoring aims at measuring the likelihood score of a sentence and is widely used in many natural language processing scenarios, like reranking, which is to select the best sentence from multiple candidates. Previ…

Causal Language ModelingLanguage ModelingLanguage ModellingMasked Language Modeling+2

The AFRL IWSLT 2020 Systems: Work-From-Home Edition

2020-07-01 · WS 2020 7 · Brian Ore, Eric Hansen, Tim Anderson, Jeremy Gwinnup

This report summarizes the Air Force Research Laboratory (AFRL) submission to the offline spoken language translation (SLT) task as part of the IWSLT 2020 evaluation campaign. As in previous years, we chose to adopt the …

Action DetectionActivity DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)+9

RescoreBERT: Discriminative Speech Recognition Rescoring with BERT

2022-02-02 · Liyan Xu, Yile Gu, Jari Kolehmainen, Haidar Khan 외

Second-pass rescoring is an important component in automatic speech recognition (ASR) systems that is used to improve the outputs from a first-pass decoder by implementing a lattice rescoring or $n$-best re-ranking. Whil…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderLanguage Modelling+4

Discriminative Speech Recognition Rescoring with Pre-trained Language Models

2023-10-10 · Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yile Gu, Ankur Gandhe 외

Second pass rescoring is a critical component of competitive automatic speech recognition (ASR) systems. Large language models have demonstrated their ability in using pre-trained information for better rescoring of ASR …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

An Effective Contextual Language Modeling Framework for Speech Summarization with Augmented Features

2020-06-01 · Shi-Yan Weng, Tien-Hong Lo, Berlin Chen

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supe…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+5