Joint Line Segmentation and Transcription for End-to-End Handwritten Paragraph Recognition
Offline handwriting recognition systems require cropped text line images for both training and recognition. On the one hand, the annotation of position and transcript at line level is costly to obtain. On the other hand, automatic line segmentation algorithms are prone to errors, compromising the subsequent recognition. In this paper, we propose a modification of the popular and efficient Multi-Dimensional Long Short-Term Memory Recurrent Neural Networks (MDLSTM-RNNs) to enable end-to-end processing of handwritten paragraphs. More particularly, we replace the collapse layer transforming the two-dimensional representation into a sequence of predictions by a recurrent version which can select one line at a time. In the proposed model, a neural network performs a kind of implicit line segmentation by computing attention weights on the image representation. The experiments on paragraphs of Rimes and IAM databases yield results that are competitive with those of networks trained at line level, and constitute a significant step towards end-to-end transcription of full documents.
Code (0)
등록된 구현이 없습니다.
Tasks
Handwriting RecognitionSegmentationSimilar Papers 제목 키워드 기반
Joint Line Segmentation and Transcription for End-to-End Handwritten Paragraph Recognition
Offline handwriting recognition systems require cropped text line images for both training and recognition. On the one hand, the annotation of position and transcript at line level is costly to obtain. On the other hand,…
Handwriting RecognitionSegmentationScan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attention
We present an attention-based model for end-to-end handwriting recognition. Our system does not require any segmentation of the input paragraph. The model is inspired by the differentiable attention models presented rece…
Handwriting RecognitionImage CaptioningSegmentationspeech-recognition+2SPAN: a Simple Predict & Align Network for Handwritten Paragraph Recognition
Unconstrained handwriting recognition is an essential task in document analysis. It is usually carried out in two steps. First, the document is segmented into text lines. Second, an Optical Character Recognition model is…
Handwriting RecognitionHandwritten Text RecognitionOptical Character RecognitionOptical Character Recognition (OCR)+1End-to-end Handwritten Paragraph Text Recognition Using a Vertical Attention Network
Unconstrained handwritten text recognition remains challenging for computer vision systems. Paragraph text recognition is traditionally achieved by two models: the first one for line segmentation and the second one for t…
DecoderHandwritten Text RecognitionHandwriting Recognition
This paper describes the method to recognize offline handwritten characters. A robust algorithm for handwriting segmentation is described here with the help of which individual characters can be segmented from a selected…
Handwriting RecognitionSegmentation