Improving accuracy and speeding up Document Image Classification through parallel systems
This paper presents a study showing the benefits of the EfficientNet models compared with heavier Convolutional Neural Networks (CNNs) in the Document Classification task, essential problem in the digitalization process of institutions. We show in the RVL-CDIP dataset that we can improve previous results with a much lighter model and present its transfer learning capabilities on a smaller in-domain dataset such as Tobacco3482. Moreover, we present an ensemble pipeline which is able to boost solely image input by combining image model predictions with the ones generated by BERT model on extracted text by OCR. We also show that the batch size can be effectively increased without hindering its accuracy so that the training process can be sped up by parallelizing throughout multiple GPUs, decreasing the computational time needed. Lastly, we expose the training performance differences between PyTorch and Tensorflow Deep Learning frameworks.
Code (1)
Tasks
Document Classificationdocument-image-classificationDocument Image ClassificationGeneral Classificationimage-classificationImage ClassificationMulti-Modal Document ClassificationOptical Character Recognition (OCR)Transfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Speeding Document Annotation with Topic Models
ALTO: Active Learning with Topic Overviews for Speeding Label Induction and Document Labeling
DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotation
Automating the annotation of scanned documents is challenging, requiring a balance between computational efficiency and accuracy. DocParseNet addresses this by combining deep learning and multi-modal learning to process …
Computational EfficiencyOptical Character Recognition (OCR)Semantic SegmentationSpeeding up Word Mover's Distance and its variants via properties of distances between embeddings
The Word Mover's Distance (WMD) proposed by Kusner et al. is a distance between documents that takes advantage of semantic relations among words that are captured by their embeddings. This distance proved to be quite eff…
Document ClassificationGeneral ClassificationDWT-CompCNN: Deep Image Classification Network for High Throughput JPEG 2000 Compressed Documents
For any digital application with document images such as retrieval, the classification of document images becomes an essential stage. Conventionally for the purpose, the full versions of the documents, that is the uncomp…
Classificationimage-classificationImage ClassificationRetrieval