Keyword-Guided Adaptation of Automatic Speech Recognition
Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon. In this paper, we propose a novel approach for improved jargon word recognition by contextual biasing Whisper-based models. We employ a keyword spotting model that leverages the Whisper encoder representation to dynamically generate prompts for guiding the decoder during the transcription process. We introduce two approaches to effectively steer the decoder towards these prompts: KG-Whisper, which is aimed at fine-tuning the Whisper decoder, and KG-Whisper-PT, which learns a prompt prefix. Our results show a significant improvement in the recognition accuracy of specified keywords and in reducing the overall word error rates. Specifically, in unseen language generalization, we demonstrate an average WER improvement of 5.1% over Whisper.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKeyword Spottingspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Large Vocabulary Spontaneous Speech Recognition for Tigrigna
This thesis proposes and describes a research attempt at designing and developing a speaker independent spontaneous automatic speech recognition system for Tigrigna The acoustic model of the Speech Recognition System is …
Automatic Speech RecognitionLanguage ModelingLanguage Modellingspeech-recognition+1LM-assisted keyword biasing with Aho-Corasick algorithm for Transducer-based ASR
Despite the recent success of end-to-end models for automatic speech recognition, recognizing special rare and out-of-vocabulary words, as well as fast domain adaptation with text, are still challenging. It often happens…
ARCAutomatic Speech RecognitionDomain AdaptationLanguage Modeling+3Multi-layer Attention Mechanism for Speech Keyword Recognition
As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastru…
Keyword Spottingspeech-recognitionSpeech RecognitionInterBiasing: Boost Unseen Word Recognition through Biasing Intermediate Predictions
Despite recent advances in end-to-end speech recognition methods, their output is biased to the training data's vocabulary, resulting in inaccurate recognition of unknown terms or proper nouns. To improve the recognition…
speech-recognitionSpeech Recognitiontext-to-speechText to SpeechMeta-Learning for improving rare word recognition in end-to-end ASR
We propose a new method of generating meaningful embeddings for speech, changes to four commonly used meta learning approaches to enable them to perform keyword spotting in continuous signals and an approach of combining…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Keyword SpottingMeta-Learning+2