PyChain: A Fully Parallelized PyTorch Implementation of LF-MMI for End-to-End ASR
We present PyChain, a fully parallelized PyTorch implementation of end-to-end lattice-free maximum mutual information (LF-MMI) training for the so-called \emph{chain models} in the Kaldi automatic speech recognition (ASR) toolkit. Unlike other PyTorch and Kaldi based ASR toolkits, PyChain is designed to be as flexible and light-weight as possible so that it can be easily plugged into new ASR projects, or other existing PyTorch-based ASR tools, as exemplified respectively by a new project PyChain-example, and Espresso, an existing end-to-end ASR toolkit. PyChain's efficiency and flexibility is demonstrated through such novel features as full GPU training on numerator/denominator graphs, and support for unequal length sequences. Experiments on the WSJ dataset show that with simple neural networks and commonly used machine learning techniques, PyChain can achieve competitive results that are comparable to Kaldi and better than other end-to-end ASR systems.
Code (1)
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)GPUspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Implementing Recycling Methods for Linear Systems in Python with an Application to Multiple Objective Optimization
Sequences of linear systems arise in the predictor-corrector method when computing the Pareto front for multi-objective optimization. Rather than discarding information generated when solving one system, it may be advant…
A Parallel Implementation of Computing Mean Average Precision
Mean Average Precision (mAP) has been widely used for evaluating the quality of object detectors, but an efficient implementation is still absent. Current implementations can only count true positives (TP's) and false po…
Parallelizable Stack Long Short-Term Memory
Stack Long Short-Term Memory (StackLSTM) is useful for various applications such as parsing and string-to-tree neural machine translation, but it is also known to be notoriously difficult to parallelize for GPU training …
GPUMachine TranslationTranslationPeppyChains: Simplifying the assembly of 3D-printed generic protein models
Peppytides is a coarse-grained, accurate, physical model of the polypeptide chain. I have shared instructions to make your own polypeptide chain and STL files of Peppytides in MAKE magazine in Jan 2014 issue. However, Pe…
GPU-Accelerated Forward-Backward algorithm with Application to Lattice-Free MMI
We propose to express the forward-backward algorithm in terms of operations between sparse matrices in a specific semiring. This new perspective naturally leads to a GPU-friendly algorithm which is easy to implement in J…
GPU