paper-with-me

Papers

Spelling Correction through Rewriting of Non-Autoregressive ASR Lattices

2024-09-24 · Leonid Velikovich, Christopher Li, Diamantino Caseiro, Shankar Kumar, Pat Rondon, Kandarp Joshi, Xavier Velez

For end-to-end Automatic Speech Recognition (ASR) models, recognizing personal or rare phrases can be hard. A promising way to improve accuracy is through spelling correction (or rewriting) of the ASR lattice, where potentially misrecognized phrases are replaced with acoustically similar and contextually relevant alternatives. However, rewriting is challenging for ASR models trained with connectionist temporal classification (CTC) due to noisy hypotheses produced by a non-autoregressive, context-independent beam search. We present a finite-state transducer (FST) technique for rewriting wordpiece lattices generated by Transformer-based CTC models. Our algorithm performs grapheme-to-phoneme (G2P) conversion directly from wordpieces into phonemes, avoiding explicit word representations and exploiting the richness of the CTC lattice. Our approach requires no retraining or modification of the ASR model. We achieved up to a 15.2% relative reduction in sentence error rate (SER) on a test set with contextually relevant entities.

📄 PDF Abstract BibTeX arXiv:2409.16469

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognitionSpeech RecognitionSpelling Correction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systems

2022-03-02 · Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic 외

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phra…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

Retrieval Augmented Spelling Correction for E-Commerce Applications

2024-10-15 · Xuan Guo, Rohit Patki, Dante Everaert, Christopher Potts

The rapid introduction of new brand names into everyday language poses a unique challenge for e-commerce spelling correction services, which must distinguish genuine misspellings from novel brand names that use unconvent…

Language ModelingLanguage ModellingLarge Language ModelRAG+3

Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction

2022-11-23 · Kai Shen, Yichong Leng, Xu Tan, Siliang Tang 외

Text error correction aims to correct the errors in text sequences such as those typed by humans or generated by speech recognition models. Previous error correction methods usually take the source (incorrect) sentence a…

DecoderSentencespeech-recognitionSpeech Recognition

English Language Spelling Correction as an Information Retrieval Task Using Wikipedia Search Statistics

2022-06-01 · LREC 2022 6 · Kyle Goslin, Markus Hofmann

Spelling correction utilities have become commonplace during the writing process, however, many spelling correction utilities suffer due to the size and quality of dictionaries available to aid correction. Many terms, ac…

Information RetrievalRetrievalSpelling Correction

Vision Language Models Are Not (Yet) Spelling Correctors

2025-09-22 · Junhong Liang, Bojun Zhang arxiv

Spelling correction from visual input poses unique challenges for vision language models (VLMs), as it requires not only detecting but also correcting textual errors directly within images. We present ReViCo (Real Visual…