paper-with-me

홈 › Papers

Error Correction in ASR using Sequence-to-Sequence Models

2022-02-02 · Samrat Dutta, Shreyansh Jain, Ayush Maheshwari, Souvik Pal, Ganesh Ramakrishnan, Preethi Jyothi

Post-editing in Automatic Speech Recognition (ASR) entails automatically correcting common and systematic errors produced by the ASR system. The outputs of an ASR system are largely prone to phonetic and spelling errors. In this paper, we propose to use a powerful pre-trained sequence-to-sequence model, BART, further adaptively trained to serve as a denoising model, to correct errors of such types. The adaptive training is performed on an augmented dataset obtained by synthetically inducing errors as well as by incorporating actual errors from an existing ASR system. We also propose a simple approach to rescore the outputs using word level alignments. Experimental results on accented speech data demonstrate that our strategy effectively rectifies a significant number of ASR errors and produces improved WER results when compared against a competitive baseline. We also highlight a negative result obtained on the related grammatical error correction task in Hindi language showing the limitation in capturing wider context by our proposed model.

📄 PDF Abstract BibTeX arXiv:2202.01157

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DenoisingGrammatical Error Correctionspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Error correction and extraction in request dialogs

2020-04-08 · Stefan Constantin, Alex Waibel

We propose a dialog system utility component that gets the last two utterances of a user and can detect whether the last utterance is an error correction of the second last utterance. If yes, it corrects the second last …

Grammatical Error Correction as GAN-like Sequence Labeling

2021-05-29 · Findings (ACL) 2021 8 · Kevin Parnow, Zuchao Li, Hai Zhao

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are p…

Grammatical Error Correction

Automatic Grammatical Error Correction for Sequence-to-sequence Text Generation: An Empirical Study

2019-07-01 · ACL 2019 7 · Tao Ge, Xingxing Zhang, Furu Wei, Ming Zhou

Sequence-to-sequence (seq2seq) models have achieved tremendous success in text generation tasks. However, there is no guarantee that they can always generate sentences without grammatical errors. In this paper, we presen…

Formality Style TransferGrammatical Error CorrectionMachine TranslationSentence+4

Seq2Edits: Sequence Transduction Using Span-level Edit Operations

2020-09-23 · EMNLP 2020 11 · Felix Stahlberg, Shankar Kumar

We propose Seq2Edits, an open-vocabulary approach to sequence editing for natural language processing (NLP) tasks with a high degree of overlap between input and output texts. In this approach, each sequence-to-sequence …

Grammatical Error CorrectionSentenceSentence FusionTAG+2

Sequence-to-Action: Grammatical Error Correction with Action Guided Sequence Generation

2022-05-22 · Jiquan Li, Junliang Guo, Yongxin Zhu, Xin Sheng 외

The task of Grammatical Error Correction (GEC) has received remarkable attention with wide applications in Natural Language Processing (NLP) in recent years. While one of the key principles of GEC is to keep the correct …

Grammatical Error CorrectionSentence