paper-with-me

Papers

Can Generative Large Language Models Perform ASR Error Correction?

2023-07-09 · Rao Ma, Mengjie Qian, Potsawee Manakul, Mark Gales, Kate Knill

ASR error correction is an interesting option for post processing speech recognition system outputs. These error correction models are usually trained in a supervised fashion using the decoding results of a target ASR system. This approach can be computationally intensive and the model is tuned to a specific ASR system. Recently generative large language models (LLMs) have been applied to a wide range of natural language processing tasks, as they can operate in a zero-shot or few shot fashion. In this paper we investigate using ChatGPT, a generative LLM, for ASR error correction. Based on the ASR N-best output, we propose both unconstrained and constrained, where a member of the N-best list is selected, approaches. Additionally, zero and 1-shot settings are evaluated. Experiments show that this generative LLM approach can yield performance gains for two different state-of-the-art ASR architectures, transducer and attention-encoder-decoder based, and multiple test sets.

📄 PDF Abstract BibTeX arXiv:2307.04172

Code (0)

등록된 구현이 없습니다.

Tasks

Decoderspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Benchmarking Japanese Speech Recognition on ASR-LLM Setups with Multi-Pass Augmented Generative Error Correction

2024-08-29 · Yuka Ko, Sheng Li, Chao-Han Huck Yang, Tatsuya Kawahara

With the strong representational power of large language models (LLMs), generative error correction (GER) for automatic speech recognition (ASR) aims to provide semantic and phonetic refinements to address ASR errors. Th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)BenchmarkingLanguage Modeling+3

Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition

2024-09-15 · Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li 외

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion RecognitionLanguage Modeling+4

LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context

2025-05-23 · Natsuo Yamashita, Masaaki Yamamoto, Hiroaki Kokubo, Yohei Kawaguchi

Generative error correction (GER) with large language models (LLMs) has emerged as an effective post-processing approach to improve automatic speech recognition (ASR) performance. However, it often struggles with rare or…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Generative error correction for code-switching speech recognition using large language models

2023-10-17 · Chen Chen, Yuchen Hu, Chao-Han Huck Yang, Hexin Liu 외

Code-switching (CS) speech refers to the phenomenon of mixing two or more languages within the same sentence. Despite the recent advances in automatic speech recognition (ASR), CS-ASR is still a challenging task ought to…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModellingSentence+2

Large Language Model Should Understand Pinyin for Chinese ASR Error Correction

2024-09-20 · Yuang Li, Xiaosong Qiao, Xiaofeng Zhao, Huan Zhao 외

Large language models can enhance automatic speech recognition systems through generative error correction. In this paper, we propose Pinyin-enhanced GEC, which leverages Pinyi, the phonetic representation of Mandarin Ch…

Automatic Speech RecognitionLanguage ModelingLanguage ModellingLarge Language Model+2