paper-with-me

Papers

Improving accuracy and speeding up Document Image Classification through parallel systems

2020-06-16 · Javier Ferrando, Juan Luis Dominguez, Jordi Torres, Raul Garcia, David Garcia, Daniel Garrido, Jordi Cortada, Mateo Valero

This paper presents a study showing the benefits of the EfficientNet models compared with heavier Convolutional Neural Networks (CNNs) in the Document Classification task, essential problem in the digitalization process of institutions. We show in the RVL-CDIP dataset that we can improve previous results with a much lighter model and present its transfer learning capabilities on a smaller in-domain dataset such as Tobacco3482. Moreover, we present an ensemble pipeline which is able to boost solely image input by combining image model predictions with the ones generated by BERT model on extracted text by OCR. We also show that the batch size can be effectively increased without hindering its accuracy so that the training process can be sped up by parallelizing throughout multiple GPUs, decreasing the computational time needed. Lastly, we expose the training performance differences between PyTorch and Tensorflow Deep Learning frameworks.

📄 PDF Abstract BibTeX arXiv:2006.09141

Code (1)

javiferran/document-classification pytorch

Tasks

Document Classificationdocument-image-classificationDocument Image ClassificationGeneral Classificationimage-classificationImage ClassificationMulti-Modal Document ClassificationOptical Character Recognition (OCR)Transfer Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Speeding Document Annotation with Topic Models

2015-06-01 · NAACL 2015 6 · Forough Poursabzi-Sangdeh, Jordan Boyd-Graber
Document ClassificationGeneral ClassificationText ClassificationTopic Models

ALTO: Active Learning with Topic Overviews for Speeding Label Induction and Document Labeling

2016-08-01 · ACL 2016 8 · Forough Poursabzi-Sangdeh, Jordan Boyd-Graber, Leah Findlater, Kevin Seppi
Active LearningText ClassificationTopic Models

DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotation

2024-06-25 · Ahmad Mohammadshirazi, Ali Nosrati Firoozsalari, Mengxi Zhou, Dheeraj Kulshrestha 외

Automating the annotation of scanned documents is challenging, requiring a balance between computational efficiency and accuracy. DocParseNet addresses this by combining deep learning and multi-modal learning to process …

Computational EfficiencyOptical Character Recognition (OCR)Semantic Segmentation

Speeding up Word Mover's Distance and its variants via properties of distances between embeddings

2019-12-01 · Matheus Werner, Eduardo Laber

The Word Mover's Distance (WMD) proposed by Kusner et al. is a distance between documents that takes advantage of semantic relations among words that are captured by their embeddings. This distance proved to be quite eff…

Document ClassificationGeneral Classification

DWT-CompCNN: Deep Image Classification Network for High Throughput JPEG 2000 Compressed Documents

2023-06-02 · Tejasvee Bisen, Mohammed Javed, Shashank Kirtania, P. Nagabhushan

For any digital application with document images such as retrieval, the classification of document images becomes an essential stage. Conventionally for the purpose, the full versions of the documents, that is the uncomp…

Classificationimage-classificationImage ClassificationRetrieval