Hybrid CTC-Attention based End-to-End Speech Recognition using Subword Units
In this paper, we present an end-to-end automatic speech recognition system, which successfully employs subword units in a hybrid CTC-Attention based system. The subword units are obtained by the byte-pair encoding (BPE) compression algorithm. Compared to using words as modeling units, using characters or subword units does not suffer from the out-of-vocabulary (OOV) problem. Furthermore, using subword units further offers a capability in modeling longer context than using characters. We evaluate different systems over the LibriSpeech 1000h dataset. The subword-based hybrid CTC-Attention system obtains 6.8% word error rate (WER) on the test_clean subset without any dictionary or external language model. This represents a significant improvement (a 12.8% WER relative reduction) over the character-based hybrid CTC-Attention system.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Techniques for Vocabulary Expansion in Hybrid Speech Recognition Systems
The problem of out of vocabulary words (OOV) is typical for any speech recognition system, hybrid systems are usually constructed to recognize a fixed set of words and rarely can include all the words that will be encoun…
graph constructionspeech-recognitionSpeech RecognitionAcoustic Data-Driven Subword Modeling for End-to-End Speech Recognition
Subword units are commonly used for end-to-end automatic speech recognition (ASR), while a fully acoustic-oriented subword modeling approach is somewhat missing. We propose an acoustic data-driven subword modeling (ADSM)…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Segmentationspeech-recognition+2Improved training of end-to-end attention models for speech recognition
Sequence-to-sequence attention-based models on subword units allow simple open-vocabulary end-to-end speech recognition. In this work, we show that such models can achieve competitive results on the Switchboard 300h and …
Language ModelingLanguage ModellingSpeech RecognitionSubword Regularization: An Analysis of Scalability and Generalization for End-to-End Automatic Speech Recognition
Subwords are the most widely used output units in end-to-end speech recognition. They combine the best of two worlds by modeling the majority of frequent words directly and at the same time allow open vocabulary speech r…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DiversityMachine Translation+4An investigation of phone-based subword units for end-to-end speech recognition
Phones and their context-dependent variants have been the standard modeling units for conventional speech recognition systems, while characters and subwords have demonstrated their effectiveness for end-to-end recognitio…
DecoderLanguage ModelingLanguage Modellingspeech-recognition+1