Post-OCR Paragraph Recognition by Graph Convolutional Networks
We propose a new approach for paragraph recognition in document images by spatial graph convolutional networks (GCN) applied on OCR text boxes. Two steps, namely line splitting and line clustering, are performed to extract paragraphs from the lines in OCR results. Each step uses a beta-skeleton graph constructed from bounding boxes, where the graph edges provide efficient support for graph convolution operations. With only pure layout input features, the GCN model size is 3~4 orders of magnitude smaller compared to R-CNN based models, while achieving comparable or better accuracies on PubLayNet and other datasets. Furthermore, the GCN models show good generalization from synthetic training data to real-world images, and good adaptivity for variable document styles.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringOptical Character Recognition (OCR)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GatedLexiconNet: A Comprehensive End-to-End Handwritten Paragraph Text Recognition System
The Handwritten Text Recognition problem has been a challenge for researchers for the last few decades, especially in the domain of computer vision, a subdomain of pattern recognition. Variability of texts amongst writer…
Handwritten Text RecognitionSegmentationConvolutional Auto-encoding of Sentence Topics for Image Paragraph Generation
Image paragraph generation is the task of producing a coherent story (usually a paragraph) that describes the visual content of an image. The problem nevertheless is not trivial especially when there are multiple descrip…
DescriptiveImage Paragraph CaptioningSentencevalidSPAN: a Simple Predict & Align Network for Handwritten Paragraph Recognition
Unconstrained handwriting recognition is an essential task in document analysis. It is usually carried out in two steps. First, the document is segmented into text lines. Second, an Optical Character Recognition model is…
Handwriting RecognitionHandwritten Text RecognitionOptical Character RecognitionOptical Character Recognition (OCR)+1End-to-end Handwritten Paragraph Text Recognition Using a Vertical Attention Network
Unconstrained handwritten text recognition remains challenging for computer vision systems. Paragraph text recognition is traditionally achieved by two models: the first one for line segmentation and the second one for t…
DecoderHandwritten Text RecognitionBayesian Paragraph Vectors
Word2vec (Mikolov et al., 2013) has proven to be successful in natural language processing by capturing the semantic relationships between different words. Built on top of single-word embeddings, paragraph vectors (Le an…
Sentiment AnalysisWord Embeddings