DisfluencyFixer: A tool to enhance Language Learning through Speech To Speech Disfluency Correction
Conversational speech often consists of deviations from the speech plan, producing disfluent utterances that affect downstream NLP tasks. Removing these disfluencies is necessary to create fluent and coherent speech. This paper presents DisfluencyFixer, a tool that performs speech-to-speech disfluency correction in English and Hindi using a pipeline of Automatic Speech Recognition (ASR), Disfluency Correction (DC) and Text-To-Speech (TTS) models. Our proposed system removes disfluencies from input speech and returns fluent speech as output along with its transcript, disfluency type and total disfluency count in source utterance, providing a one-stop destination for language learners to improve the fluency of their speech. We evaluate the performance of our tool subjectively and receive scores of 4.26, 4.29 and 4.42 out of 5 in ASR performance, DC performance and ease-of-use of the system. Our tool can be accessed openly at the following link.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognitiontext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet
As Automatic Speech Processing (ASR) systems are getting better, there is an increasing interest of using the ASR output to do downstream Natural Language Processing (NLP) tasks. However, there are few open source toolki…
Spoken Language Understandingtext-to-speechText to SpeechUser-friendly automatic transcription of low-resource languages: Plugging ESPnet into Elpis
This paper reports on progress integrating the speech recognition toolkit ESPnet into Elpis, a web front-end originally designed to provide access to the Kaldi automatic speech recognition toolkit. The goal of this work …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionEnhanced CORILGA: Introducing the Automatic Phonetic Alignment Tool for Continuous Speech
The {``}Corpus Oral Informatizado da Lingua Galega (CORILGA){''} project aims at building a corpus of oral language for Galician, primarily designed to study the linguistic variation and change. This project is currently…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognition+1Building state-of-the-art distant speech recognition using the CHiME-4 challenge with a setup of speech enhancement baseline
This paper describes a new baseline system for automatic speech recognition (ASR) in the CHiME-4 challenge to promote the development of noisy ASR in speech processing communities by providing 1) state-of-the-art system …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Distant Speech RecognitionLanguage Modeling+5Open-Source Conversational AI with SpeechBrain 1.0
SpeechBrain is an open-source Conversational AI toolkit based on PyTorch, focused particularly on speech processing tasks such as speech recognition, speech enhancement, speaker recognition, text-to-speech, and much more…
Language ModelingLanguage ModellingLarge Language ModelSpeaker Recognition+5