Efficient Document Image Classification Using Region-Based Graph Neural Network
Document image classification remains a popular research area because it can be commercialized in many enterprise applications across different industries. Recent advancements in large pre-trained computer vision and language models and graph neural networks has lent document image classification many tools. However using large pre-trained models usually requires substantial computing resources which could defeat the cost-saving advantages of automatic document image classification. In the paper we propose an efficient document image classification framework that uses graph convolution neural networks and incorporates textual, visual and layout information of the document. We have rigorously benchmarked our proposed algorithm against several state-of-art vision and language models on both publicly available dataset and a real-life insurance document classification dataset. Empirical results on both publicly available and real-world data show that our methods achieve near SOTA performance yet require much less computing resources and time for model training and inference. This results in solutions than offer better cost advantages, especially in scalable deployment for enterprise applications. The results showed that our algorithm can achieve classification performance quite close to SOTA. We also provide comprehensive comparisons of computing resources, model sizes, train and inference time between our proposed methods and baselines. In addition we delineate the cost per image using our method and other baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDocument Classificationdocument-image-classificationDocument Image ClassificationGraph Neural Networkimage-classificationImage ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks
In this work, a region-based Deep Convolutional Neural Network framework is proposed for document structure learning. The contribution of this work involves efficient training of region based classifiers and effective en…
document-image-classificationDocument Image ClassificationGeneral Classificationimage-classification+2Multimodal weighted graph representation for information extraction from visually rich documents.
This paper introduces a novel system for information extraction from visually rich documents (VRD) using a weighted graph representation. The proposed method aims to improve the performance of the information extraction …
Document Layout Analysisdocument understandingGraph Neural NetworkInformation Retrieval+2Spatial Dual-Modality Graph Reasoning for Key Information Extraction
Key information extraction from document images is of paramount importance in office automation. Conventional template matching based approaches fail to generalize well to document images of unseen templates, and are not…
Key Information ExtractionTemplate MatchingNeural User Factor Adaptation for Text Classification: Learning to Generalize Across Author Demographics
Language use varies across different demographic factors, such as gender, age, and geographic location. However, most existing document classification methods ignore demographic variability. In this study, we examine emp…
ClassificationDocument ClassificationGeneral Classificationtext-classification+1Analysis of Convolutional Neural Networks for Document Image Classification
Convolutional Neural Networks (CNNs) are state-of-the-art models for document image classification tasks. However, many of these approaches rely on parameters and architectures designed for classifying natural images, wh…
ClassificationData Augmentationdocument-image-classificationDocument Image Classification+3