Dropout improves Recurrent Neural Networks for Handwriting Recognition
Recurrent neural networks (RNNs) with Long Short-Term memory cells currently hold the best known results in unconstrained handwriting recognition. We show that their performance can be greatly improved using dropout - a recently proposed regularization method for deep architectures. While previous works showed that dropout gave superior performance in the context of convolutional networks, it had never been applied to RNNs. In our approach, dropout is carefully used in the network so that it does not affect the recurrent connections, hence the power of RNNs in modeling sequence is preserved. Extensive experiments on a broad range of handwritten databases confirm the effectiveness of dropout on deep architectures even when the network mainly consists of recurrent and shared connections.
Code (0)
등록된 구현이 없습니다.
Tasks
Handwriting RecognitionSimilar Papers 제목 키워드 기반
Fine-tuning Handwriting Recognition systems with Temporal Dropout
This paper introduces a novel method to fine-tune handwriting recognition systems based on Recurrent Neural Networks (RNN). Long Short-Term Memory (LSTM) networks are good at modeling long sequences but they tend to over…
Handwriting RecognitionUnconstrained On-line Handwriting Recognition with Recurrent Neural Networks
On-line handwriting recognition is unusual among sequence labelling tasks in that the underlying generator of the observed data, i.e. the movement of the pen, is recorded directly. However, the raw data can be difficult …
Handwriting RecognitionLanguage ModelingLanguage ModellingCITlab ARGUS for Arabic Handwriting
In the recent years it turned out that multidimensional recurrent neural networks (MDRNN) perform very well for offline handwriting recognition tasks like the OpenHaRT 2013 evaluation DIR. With suitable writing preproces…
Handwriting RecognitionOffline Handwriting Recognition with Multidimensional Recurrent Neural Networks
Offline handwriting recognition---the transcription of images of handwritten text---is an interesting task, in that it combines computer vision with sequence learning. In most systems the two elements are handled separat…
Handwriting RecognitionHandwritten Bangla Digit Recognition Using Deep Learning
In spite of the advances in pattern recognition technology, Handwritten Bangla Character Recognition (HBCR) (such as alpha-numeric and special characters) remains largely unsolved due to the presence of many perplexing c…
Deep Learning