paper-with-me

홈 › Papers

Qalam : A Multimodal LLM for Arabic Optical Character and Handwriting Recognition

2024-07-18 · Gagan Bhatia, El Moatez Billah Nagoudi, Fakhraddin Alwajih, Muhammad Abdul-Mageed

Arabic Optical Character Recognition (OCR) and Handwriting Recognition (HWR) pose unique challenges due to the cursive and context-sensitive nature of the Arabic script. This study introduces Qalam, a novel foundation model designed for Arabic OCR and HWR, built on a SwinV2 encoder and RoBERTa decoder architecture. Our model significantly outperforms existing methods, achieving a Word Error Rate (WER) of just 0.80% in HWR tasks and 1.18% in OCR tasks. We train Qalam on a diverse dataset, including over 4.5 million images from Arabic manuscripts and a synthetic dataset comprising 60k image-text pairs. Notably, Qalam demonstrates exceptional handling of Arabic diacritics, a critical feature in Arabic scripts. Furthermore, it shows a remarkable ability to process high-resolution inputs, addressing a common limitation in current OCR systems. These advancements underscore Qalam's potential as a leading solution for Arabic script recognition, offering a significant leap in accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2407.13559

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderHandwriting RecognitionOptical Character RecognitionOptical Character Recognition (OCR)

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Residual Connection 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

AltecOnDB: A Large-Vocabulary Arabic Online Handwriting Recognition Database

2014-12-24 · Ibrahim Abdelaziz, Sherif Abdou

Arabic is a semitic language characterized by a complex and rich morphology. The exceptional degree of ambiguity in the writing system, the rich morphology, and the highly complex word formation process of roots and patt…

Handwriting RecognitionSentence

A Novel Method for the Recognition of Isolated Handwritten Arabic Characters

2014-02-26 · Ahmed Sahlol, Cheng Suen

There are many difficulties facing a handwritten Arabic recognition system such as unlimited variation in human handwriting, similarities of distinct character shapes, interconnections of neighbouring characters and thei…

Optical Character RecognitionOptical Character Recognition (OCR)

Handwritten Urdu Character Recognition using 1-Dimensional BLSTM Classifier

2017-05-15 · Saad Bin Ahmed, Saeeda Naz, Salahuddin Swati, Muhammad Imran Razzak

The recognition of cursive script is regarded as a subtle task in optical character recognition due to its varied representation. Every cursive script has different nature and associated challenges. As Urdu is one of cur…

Optical Character RecognitionOptical Character Recognition (OCR)

Handwriting Recognition in Historical Documents with Multimodal LLM

2024-10-31 · Lucian Li

There is an immense quantity of historical and cultural documentation that exists only as handwritten manuscripts. At the same time, performing OCR across scripts and different handwriting styles has proven to be an enor…

Handwriting RecognitionOptical Character RecognitionOptical Character Recognition (OCR)

A Hybrid NN/HMM Modeling Technique for Online Arabic Handwriting Recognition

2014-01-02 · Najiba Tagougui, Houcine Boubaker, Monji Kherallah, Adel M. ALIMI

In this work we propose a hybrid NN/HMM model for online Arabic handwriting recognition. The proposed system is based on Hidden Markov Models (HMMs) and Multi Layer Perceptron Neural Networks (MLPNNs). The input signal i…

Handwriting Recognition