paper-with-me

홈 › Papers

Integrated Semantic and Phonetic Post-correction for Chinese Speech Recognition

2021-11-16 · ROCLING 2021 10 · Yi-Chang Chen, Chun-Yen Cheng, Chien-An Chen, Ming-Chieh Sung, Yi-Ren Yeh

Due to the recent advances of natural language processing, several works have applied the pre-trained masked language model (MLM) of BERT to the post-correction of speech recognition. However, existing pre-trained models only consider the semantic correction while the phonetic features of words is neglected. The semantic-only post-correction will consequently decrease the performance since homophonic errors are fairly common in Chinese ASR. In this paper, we proposed a novel approach to collectively exploit the contextualized representation and the phonetic information between the error and its replacing candidates to alleviate the error rate of Chinese ASR. Our experiment results on real world speech recognition datasets showed that our proposed method has evidently lower CER than the baseline model, which utilized a pre-trained BERT MLM as the corrector.

📄 PDF Abstract BibTeX arXiv:2111.08400

Code (1)

gitycc/phonetic_mlm 공식 구현 pytorch

Tasks

Language ModelingLanguage Modellingspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Disentangled Phonetic Representation for Chinese Spelling Correction

2023-05-24 · Zihong Liang, Xiaojun Quan, Qifan Wang

Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phon…

Spelling Correction

Boosting Chinese ASR Error Correction with Dynamic Error Scaling Mechanism

2023-08-07 · Jiaxin Fan, Yong Zhang, Hanzhang Li, Jianzong Wang 외

Chinese Automatic Speech Recognition (ASR) error correction presents significant challenges due to the Chinese language's unique features, including a large character set and borderless, morpheme-based structure. Current…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Non-Autoregressive Chinese ASR Error Correction with Phonological Training

2022-07-01 · NAACL 2022 7 · Zheng Fang, Ruiqing Zhang, Zhongjun He, Hua Wu 외

Automatic Speech Recognition (ASR) is an efficient and widely used input method that transcribes speech signals into text. As the errors introduced by ASR systems will impair the performance of downstream tasks, we intro…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognition+1

Hybrid phonetic-neural model for correction in speech recognition systems

2021-02-12 · Rafael Viana-Cámara, Mario Campos-Soberanis, Diego Campos-Sobrino

Automatic speech recognition (ASR) is a relevant area in multiple settings because it provides a natural communication mechanism between applications and users. ASRs often fail in environments that use language specific …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Deep Learningspeech-recognition+1

Listening, Imagining & Refining: A Heuristic Optimized ASR Correction Framework with LLMs

2025-09-18 · Yutong Liu, Ziyue Zhang, Cheng Huang, Yongbin Yu 외 arxiv

Automatic Speech Recognition (ASR) systems remain prone to errors that affect downstream applications. In this paper, we propose LIR-ASR, a heuristic optimized iterative correction framework using LLMs, inspired by human…

Speech Recognition