paper-with-me

홈 › Papers

Initial Decoding with Minimally Augmented Language Model for Improved Lattice Rescoring in Low Resource ASR

2024-03-16 · Savitha Murthy, Dinkar Sitaram

This paper addresses the problem of improving speech recognition accuracy with lattice rescoring in low-resource languages where the baseline language model is insufficient for generating inclusive lattices. We minimally augment the baseline language model with word unigram counts that are present in a larger text corpus of the target language but absent in the baseline. The lattices generated after decoding with such an augmented baseline language model are more comprehensive. We obtain 21.8% (Telugu) and 41.8% (Kannada) relative word error reduction with our proposed method. This reduction in word error rate is comparable to 21.5% (Telugu) and 45.9% (Kannada) relative word error reduction obtained by decoding with full Wikipedia text augmented language mode while our approach consumes only 1/8th the memory. We demonstrate that our method is comparable with various text selection-based language model augmentation and also consistent for data sets of different sizes. Our approach is applicable for training speech recognition systems under low resource conditions where speech data and compute resources are insufficient, while there is a large text corpus that is available in the target language. Our research involves addressing the issue of out-of-vocabulary words of the baseline in general and does not focus on resolving the absence of named entities. Our proposed method is simple and yet computationally less expensive.

📄 PDF Abstract BibTeX arXiv:2403.10937

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modellingspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

3-Model Speculative Decoding

2025-10-14 · Sanghyun Byun, Mohanad Odema, Jung Ick Guack, Baisub Lee 외 arxiv

Speculative Decoding (SD) accelerates inference in large language models by using a smaller draft model to propose tokens, which are then verified by a larger target model. However, the throughput gains of SD are fundame…

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

2024-10-01 · Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal 외

Retrieval Augmented Generation (RAG) is a widely used approach for leveraging external context in several natural language applications such as question answering and information retrieval. Yet, the exact nature in which…

Information RetrievalLanguage ModelingLanguage ModellingQuestion Answering+3

Context-Aware Initialization for Reducing Generative Path Length in Diffusion Language Models

2025-12-22 · Tongyuan Miao, Gary Huang, Kai Jun Han, Annie Jiang arxiv

Diffusion Large Language Models (DLLMs) enable fully parallel token decoding but often remain impractical at inference time due to the many denoising iterations required to refine an information-free, fully masked initia…

Minimally-Augmented Grammatical Error Correction

2019-11-01 · WS 2019 11 · Roman Grundkiewicz, Marcin Junczys-Dowmunt

There has been an increased interest in low-resource approaches to automatic grammatical error correction. We introduce Minimally-Augmented Grammatical Error Correction (MAGEC) that does not require any error-labelled da…

Grammatical Error Correction

SLAM based Quasi Dense Reconstruction For Minimally Invasive Surgery Scenes

2017-05-25 · Nader Mahmoud, Alexandre Hostettler, Toby Collins, Luc Soler 외

Recovering surgical scene structure in laparoscope surgery is crucial step for surgical guidance and augmented reality applications. In this paper, a quasi dense reconstruction algorithm of surgical scene is proposed. Th…

Patch Matching