VAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording
In this work, we propose novel decoding algorithms to enable streaming automatic speech recognition (ASR) on unsegmented long-form recordings without voice activity detection (VAD), based on monotonic chunkwise attention (MoChA) with an auxiliary connectionist temporal classification (CTC) objective. We propose a block-synchronous beam search decoding to take advantage of efficient batched output-synchronous and low-latency input-synchronous searches. We also propose a VAD-free inference algorithm that leverages CTC probabilities to determine a suitable timing to reset the model states to tackle the vulnerability to long-form data. Experimental evaluations demonstrate that the block-synchronous decoding achieves comparable accuracy to the label-synchronous one. Moreover, the VAD-free inference can recognize long-form speech robustly for up to a few hours.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Formspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Segmentation-Free Streaming Machine Translation
Streaming Machine Translation (MT) is the task of translating an unbounded input text stream in real-time. The traditional cascade approach, which combines an Automatic Speech Recognition (ASR) and an MT system, relies o…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationSegmentation+4CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Following the success of the 1st, 2nd, 3rd, 4th and 5th CHiME challenges we organize the 6th CHiME Speech Separation and Recognition Challenge (CHiME-6). The new challenge revisits the previous CHiME-5 challenge and furt…
speaker-diarizationSpeaker DiarizationSpeech Enhancementspeech-recognition+2SURT 2.0: Advances in Transducer-based Multi-talker Speech Recognition
The Streaming Unmixing and Recognition Transducer (SURT) model was proposed recently as an end-to-end approach for continuous, streaming, multi-talker speech recognition (ASR). Despite impressive results on multi-turn me…
DecoderDomain Adaptationspeech-recognitionSpeech RecognitionTurning Whisper into Real-Time Transcription System
Whisper is one of the recent state-of-the-art multilingual speech recognition and translation models, however, it is not designed for real time transcription. In this paper, we build on top of Whisper and create Whisper-…
speech-recognitionSpeech RecognitionTranslationParCzech4Speech: A New Speech Corpus Derived from Czech Parliamentary Data
We introduce ParCzech4Speech 1.0, a processed version of the ParCzech 4.0 corpus, targeted at speech modeling tasks with the largest variant containing 2,695 hours. We combined the sound recordings of the Czech parliamen…
Speech RecognitionSpeech Synthesis