paper-with-me

홈 › Papers

Handwriting Recognition in Historical Documents with Multimodal LLM

2024-10-31 · Lucian Li

There is an immense quantity of historical and cultural documentation that exists only as handwritten manuscripts. At the same time, performing OCR across scripts and different handwriting styles has proven to be an enormously difficult problem relative to the process of digitizing print. While recent Transformer based models have achieved relatively strong performance, they rely heavily on manually transcribed training data and have difficulty generalizing across writers. Multimodal LLM, such as GPT-4v and Gemini, have demonstrated effectiveness in performing OCR and computer vision tasks with few shot prompting. In this paper, I evaluate the accuracy of handwritten document transcriptions generated by Gemini against the current state of the art Transformer based methods. Keywords: Optical Character Recognition, Multimodal Language Models, Cultural Preservation, Mass digitization, Handwriting Recognitio

📄 PDF Abstract BibTeX arXiv:2410.24034

Code (0)

등록된 구현이 없습니다.

Tasks

Handwriting RecognitionOptical Character RecognitionOptical Character Recognition (OCR)

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

End-to-End Approach for Recognition of Historical Digit Strings

2021-04-28 · Mengqiao Zhao, Andre G. Hochuli, Abbas Cheddad

The plethora of digitalised historical document datasets released in recent years has rekindled interest in advancing the field of handwriting pattern recognition. In the same vein, a recently published data set, known a…

Handwriting RecognitionSegmentation

CITlab ARGUS for historical handwritten documents

2014-12-12 · Tobias Strauß, Tobias Grüning, Gundram Leifert, Roger Labahn 외

We describe CITlab's recognition system for the HTRtS competition attached to the 14. International Conference on Frontiers in Handwriting Recognition, ICFHR 2014. The task comprises the recognition of historical handwri…

General ClassificationHandwriting Recognition

Digital Peter: Dataset, Competition and Handwriting Recognition Methods

2021-03-16 · Mark Potanin, Denis Dimitrov, Alex Shonenkov, Vladimir Bataev 외

This paper presents a new dataset of Peter the Great's manuscripts and describes a segmentation procedure that converts initial images of documents into the lines. The new dataset may be useful for researchers to train h…

BIG-bench Machine LearningHandwriting RecognitionHandwritten Text Recognition

Handwriting Classification for the Analysis of Art-Historical Documents

2020-11-04 · Christian Bartz, Hendrik Rätz, Christoph Meinel

Digitized archives contain and preserve the knowledge of generations of scholars in millions of documents. The size of these archives calls for automatic analysis since a manual analysis by specialists is often too expen…

ClassificationGeneral ClassificationOptical Character Recognition (OCR)text-classification+1

Handwriting Recognition of Historical Documents with few labeled data

2018-11-10 · Chammas Edgard, Mokbel Chafic, Likforman-Sulem Laurence

Historical documents present many challenges for offline handwriting recognition systems, among them, the segmentation and labeling steps. Carefully annotated textlines are needed to train an HTR system. In some scenario…

Handwriting RecognitionHTR