Densely Connected Convolutional Networks for Speech Recognition
This paper presents our latest investigation on Densely Connected Convolutional Networks (DenseNets) for acoustic modelling (AM) in automatic speech recognition. DenseN-ets are very deep, compact convolutional neural networks, which have demonstrated incredible improvements over the state-of-the-art results on several data sets in computer vision. Our experimental results show that DenseNet can be used for AM significantly outperforming other neural-based models such as DNNs, CNNs, VGGs. Furthermore, results on Wall Street Journal revealed that with only a half of the training data DenseNet was able to outperform other models trained with the full data set by a large margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Acoustic ModellingAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Investigation of Densely Connected Convolutional Networks with Domain Adversarial Learning for Noise Robust Speech Recognition
We investigate densely connected convolutional networks (DenseNets) and their extension with domain adversarial training for noise robust speech recognition. DenseNets are very deep, compact convolutional neural networks…
Robust Speech Recognitionspeech-recognitionSpeech RecognitionThe CAPIO 2017 Conversational Speech Recognition System
In this paper we show how we have achieved the state-of-the-art performance on the industry-standard NIST 2000 Hub5 English evaluation set. We explore densely connected LSTMs, inspired by the densely connected convolutio…
image-classificationImage Classificationspeech-recognitionSpeech RecognitionConnection Reduction of DenseNet for Image Recognition
Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does …
image-classificationImage ClassificationExploiting Nontrivial Connectivity for Automatic Speech Recognition
Nontrivial connectivity has allowed the training of very deep networks by addressing the problem of vanishing gradients and offering a more efficient method of reusing parameters. In this paper we make a comparison betwe…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)General Classificationimage-classification+3Character-Level Feature Extraction with Densely Connected Networks
Generating character-level features is an important step for achieving good results in various natural language processing tasks. To alleviate the need for human labor in generating hand-crafted features, methods that ut…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3