A Comparison of Label-Synchronous and Frame-Synchronous End-to-End Models for Speech Recognition

2020-05-20 · Linhao Dong, Cheng Yi, Jianzong Wang, Shiyu Zhou, Shuang Xu, Xueli Jia, Bo Xu

End-to-end models are gaining wider attention in the field of automatic speech recognition (ASR). One of their advantages is the simplicity of building that directly recognizes the speech frame sequence into the text label sequence by neural networks. According to the driving end in the recognition process, end-to-end ASR models could be categorized into two types: label-synchronous and frame-synchronous, each of which has unique model behaviour and characteristic. In this work, we make a detailed comparison on a representative label-synchronous model (transformer) and a soft frame-synchronous model (continuous integrate-and-fire (CIF) based model). The results on three public dataset and a large-scale dataset with 12000 hours of training data show that the two types of models have respective advantages that are consistent with their synchronous mode.

📄 PDF Abstract BibTeX arXiv:2005.10113

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition Speech Recognition

Combining Frame-Synchronous and Label-Synchronous Systems for Speech Recognition

2021-07-01 · Qiujia Li, Chao Zhang, Philip C. Woodland

Commonly used automatic speech recognition (ASR) systems can be classified into frame-synchronous and label-synchronous categories, based on whether the speech is decoded on a per-frame or per-label basis. Frame-synchron…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Decoder speech-recognition+1

Adaptation of Hierarchical Structured Models for Speech Act Recognition in Asynchronous Conversation

2019-04-01 · NAACL 2019 6 · Tasnim Mohiuddin, Thanh-Tung Nguyen, Shafiq Joty

We address the problem of speech act recognition (SAR) in asynchronous conversations (forums, emails). Unlike synchronous conversations (e.g., meetings, phone), asynchronous domains lack large labeled datasets to train a…

Word Embeddings

Label-Synchronous Speech-to-Text Alignment for ASR Using Forward and Backward Transformers

2021-04-21 · Yusuke Kida, Tatsuya Komatsu, Masahito Togami

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transc…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Decoder Sentence+3

VAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording

2021-07-15 · Hirofumi Inaguma, Tatsuya Kawahara

In this work, we propose novel decoding algorithms to enable streaming automatic speech recognition (ASR) on unsegmented long-form recordings without voice activity detection (VAD), based on monotonic chunkwise attention…

Action Detection Activity Detection Automatic Speech Recognition Automatic Speech Recognition (ASR)+3

Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition

2023-07-24 · Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora 외

Although frame-based models, such as CTC and transducers, have an affinity for streaming automatic speech recognition, their decoding uses no future knowledge, which could lead to incorrect pruning. Conversely, label-bas…

Automatic Speech Recognition Decoder speech-recognition Speech Recognition