Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Models
In this paper, we propose a novel method based on character sequence-to-sequence models to correct documents already processed with Optical Character Recognition (OCR) systems. The main contribution of this paper is a set of strategies to accurately process strings much longer than the ones used to train the sequence model while being sample- and resource-efficient, supported by thorough experimentation. The strategy with the best performance involves splitting the input document in character n-grams and combining their individual corrections into the final output using a voting scheme that is equivalent to an ensemble of a large number of sequence models. We further investigate how to weigh the contributions from each one of the members of this ensemble. We test our method on nine languages of the ICDAR 2019 competition on post-OCR text correction and achieve a new state-of-the-art performance in five of them. Our code for post-OCR correction is shared at https://github.com/jarobyte91/post_ocr_correction.
Code (1)
Tasks
Optical Character RecognitionOptical Character Recognition (OCR)Similar Papers 제목 키워드 기반
A Two-Step Approach for Automatic OCR Post-Correction
The quality of Optical Character Recognition (OCR) is a key factor in the digitisation of historical documents. OCR errors are a major obstacle for downstream tasks and have hindered advances in the usage of the digitise…
Optical Character RecognitionOptical Character Recognition (OCR)Vocal Bursts Valence PredictionBART for Post-Correction of OCR Newspaper Text
Optical character recognition (OCR) from newspaper page images is susceptible to noise due to degradation of old documents and variation in typesetting. In this report, we present a novel approach to OCR post-correction.…
Language ModelingLanguage ModellingOptical Character RecognitionOptical Character Recognition (OCR)+2Toward a Period-Specific Optimized Neural Network for OCR Error Correction of Historical Hebrew Texts
Over the past few decades, large archives of paper-based historical documents, such as books and newspapers, have been digitized using the Optical Character Recognition (OCR) technology. Unfortunately, this broadly used …
Optical Character RecognitionOptical Character Recognition (OCR)Optimizing the Neural Network Training for OCR Error Correction of Historical Hebrew Texts
Over the past few decades, large archives of paper-based documents such as books and newspapers have been digitized using Optical Character Recognition. This technology is error-prone, especially for historical documents…
Optical Character RecognitionOptical Character Recognition (OCR)Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documents
We explore how multimodal Large Language Models (mLLMs) can help researchers transcribe historical documents, extract relevant historical information, and construct datasets from historical sources. Specifically, we inve…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2