RAG-Boost: Retrieval-Augmented Generation Enhanced LLM-based Speech Recognition

2025-08-05 · Pengcheng Wang, Sheng Li, Takahiro Shinozaki arxiv

In this paper, we propose RAG-Boost (ST-ShinozakiLab Task I system), which enhances the baseline LLM-based ASR system of the MLC-SLM Challenge (task I) with a retrieval-augmented generation (RAG) module on the fly. Each partial ASR hypothesis queries a vector store of audio-text pairs and domain terms, and the retrieved results are fused with the live ASR hypotheses to fix recognition errors. The fused hypotheses are passed to the LLM, yielding improved responses.

📄 PDF Abstract BibTeX arXiv:2508.14048

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Recognition

Retrieval Augmented End-to-End Spoken Dialog Models

2024-02-02 · Mingqiu Wang, Izhak Shafran, Hagen Soltau, Wei Han 외

We recently developed SLM, a joint speech and language model, which fuses a pretrained foundational speech model and a large language model (LLM), while preserving the in-context learning capability intrinsic to the pret…

dialog state tracking In-Context Learning Language Modeling Language Modelling+4

Retrieval-Augmented Audio Deepfake Detection

2024-04-22 · Zuheng Kang, Yayun He, Botao Zhao, Xiaoyang Qu 외

With recent advances in speech synthesis including text-to-speech (TTS) and voice conversion (VC) systems enabling the generation of ultra-realistic audio deepfakes, there is growing concern about their potential misuse.…

Audio Deepfake Detection DeepFake Detection Face Swapping RAG+6

cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree

2025-06-18 · Yilin Zhang, Xinran Zhao, Zora Zhiruo Wang, Chenyang Yang 외

Retrieval-Augmented Generation (RAG) has become essential for large-scale code generation, grounding predictions in external code corpora to improve actuality. However, a critical yet underexplored aspect of RAG pipeline…

Chunking Code Generation RAG Retrieval+1

Speech Retrieval-Augmented Generation without Automatic Speech Recognition

2024-12-21 · Do June Min, Karel Mundnich, Andy Lapastora, Erfan Soltanmohammadi 외

One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented generation (RAG) on the transcriptions. Wh…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Language Modeling Language Modelling+7

LA-RAG:Enhancing LLM-based ASR Accuracy with Retrieval-Augmented Generation

2024-09-13 · Shaojun Li, Hengchao Shang, Daimeng Wei, Jiaxin Guo 외

Recent advancements in integrating speech information into large language models (LLMs) have significantly improved automatic speech recognition (ASR) accuracy. However, existing methods often constrained by the capabili…

Automatic Speech Recognition Automatic Speech Recognition (ASR)In-Context Learning RAG+4