Connectionist Temporal Classification: Labelling Unsegmented Sequence Data with Recurrent Neural Networks
Many real-world sequence learning tasks require the prediction of sequences of labels from noisy, unsegmented input data. In speech recognition, for example, an acoustic signal is transcribed into words or sub-word units. Recurrent neural networks (RNNs) are powerful sequence learners that would seem well suited to such tasks. However, because they require pre-segmented training data, and post-processing to transform their outputs into label sequences, their applicability has so far been limited. This paper presents a novel method for training RNNs to label unsegmented sequences directly, thereby solving both problems. An experiment on the TIMIT speech corpus demonstrates its advantages over both a baseline HMM and a hybrid HMM-RNN.
Code (2)
Tasks
speech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Training LDCRF model on unsegmented sequences using Connectionist Temporal Classification
Many machine learning problems such as speech recognition, gesture recognition, and handwriting recognition are concerned with simultaneous segmentation and labeling of sequence data. Latent-dynamic conditional random fi…
ClassificationGeneral ClassificationGesture RecognitionHandwriting Recognition+2CTCModel: a Keras Model for Connectionist Temporal Classification
We report an extension of a Keras Model, called CTCModel, to perform the Connectionist Temporal Classification (CTC) in a transparent way. Combined with Recurrent Neural Networks, the Connectionist Temporal Classificatio…
ClassificationGeneral ClassificationmodelStar Temporal Classification: Sequence Classification with Partially Labeled Data
We develop an algorithm which can learn from partially labeled and unsegmented sequential data. Most sequential loss functions, such as Connectionist Temporal Classification (CTC), break down when many labels are missing…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)ClassificationHandwriting Recognition+2Deep Radial Embedding for Visual Sequence Learning
Connectionist Temporal Classification (CTC) is a popular objective function in sequence recognition, which provides supervision for unsegmented sequence data through aligning sequence and its corresponding labeling ite…
ARCSign Language RecognitionVAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording
In this work, we propose novel decoding algorithms to enable streaming automatic speech recognition (ASR) on unsegmented long-form recordings without voice activity detection (VAD), based on monotonic chunkwise attention…
Action DetectionActivity DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)+3