Dense Prediction on Sequences with Time-Dilated Convolutions for Speech Recognition
In computer vision pixelwise dense prediction is the task of predicting a label for each pixel in the image. Convolutional neural networks achieve good performance on this task, while being computationally efficient. In this paper we carry these ideas over to the problem of assigning a sequence of labels to a set of speech frames, a task commonly known as framewise classification. We show that dense prediction view of framewise classification offers several advantages and insights, including computational efficiency and the ability to apply batch normalization. When doing dense prediction we pay specific attention to strided pooling in time and introduce an asymmetric dilated convolution, called time-dilated convolution, that allows for efficient and elegant implementation of pooling in time. We show results using time-dilated convolutions in a very deep VGG-style CNN with batch normalization on the Hub5 Switchboard-2000 benchmark task. With a big n-gram language model, we achieve 7.7% WER which is the best single model single-pass performance reported so far.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyGeneral ClassificationLanguage ModelingLanguage ModellingPredictionspeech-recognitionSpeech RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Smoothed Dilated Convolutions for Improved Dense Prediction
Dilated convolutions, also known as atrous convolutions, have been widely explored in deep convolutional neural networks (DCNNs) for various dense prediction tasks. However, dilated convolutions suffer from the gridding …
Audio GenerationMachine TranslationObject DetectionPrediction+1Multi-Scale Context Aggregation by Dilated Convolutions
State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction and image classification are stru…
General Classificationimage-classificationPredictionReal-Time Semantic Segmentation+2Conditioned Time-Dilated Convolutions for Sound Event Detection
Sound event detection (SED) is the task of identifying sound events along with their onset and offset times. A recent, convolutional neural networks based SED method, proposed the usage of depthwise separable (DWS) and t…
Event DetectionLanguage ModellingSound Event DetectionDense Dilated Convolutions Merging Network for Semantic Mapping of Remote Sensing Images
We propose a network for semantic mapping called the Dense Dilated Convolutions Merging Network (DDCM-Net) to provide a deep learning approach that can recognize multi-scale and complex shaped objects with similar color …
Dense Dilated Convolutions Merging Network for Land Cover Classification
Land cover classification of remote sensing images is a challenging task due to limited amounts of annotated data, highly imbalanced classes, frequent incorrect pixel-level annotations, and an inherent complexity in the …
ClassificationGeneral ClassificationLand Cover ClassificationSemantic Segmentation