DocTTT: Test-Time Training for Handwritten Document Recognition Using Meta-Auxiliary Learning
Despite recent significant advancements in Handwritten Document Recognition (HDR), the efficient and accurate recognition of text against complex backgrounds, diverse handwriting styles, and varying document layouts remains a practical challenge. Moreover, this issue is seldom addressed in academic research, particularly in scenarios with minimal annotated data available. In this paper, we introduce the DocTTT framework to address these challenges. The key innovation of our approach is that it uses test-time training to adapt the model to each specific input during testing. We propose a novel Meta-Auxiliary learning approach that combines Meta-learning and self-supervised Masked Autoencoder~(MAE). During testing, we adapt the visual representation parameters using a self-supervised MAE loss. During training, we learn the model parameters using a meta-learning framework, so that the model parameters are learned to adapt to a new input effectively. Experimental results show that our proposed method significantly outperforms existing state-of-the-art approaches on benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Auxiliary LearningHandwritten Document RecognitionMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Recognizing Challenging Handwritten Annotations with Fully Convolutional Networks
This paper introduces a very challenging dataset of historic German documents and evaluates Fully Convolutional Neural Network (FCNN) based methods to locate handwritten annotations of any kind in these documents. The ha…
Data AugmentationSemantic SegmentationUnlocking the Archives: Using Large Language Models to Transcribe Handwritten Historical Documents
This study demonstrates that Large Language Models (LLMs) can transcribe historical handwritten documents with significantly higher accuracy than specialized Handwritten Text Recognition (HTR) software, while being faste…
Handwritten Text RecognitionHTRDARE: A large-scale handwritten date recognition system
Handwritten text recognition for historical documents is an important task but it remains difficult due to a lack of sufficient training data in combination with a large variability of writing styles and degradation of h…
Handwritten Text RecognitionTransfer LearningDoes color modalities affect handwriting recognition? An empirical study on Persian handwritings using convolutional neural networks
Most of the methods on handwritten recognition in the literature are focused and evaluated on Black and White (BW) image databases. In this paper we try to answer a fundamental question in document recognition. Using Con…
Handwriting RecognitionWord and character segmentation directly in run-length compressed handwritten document images
From the literature, it is demonstrated that performing text-line segmentation directly in the run-length compressed handwritten document images significantly reduces the computational time and memory space. In this pape…
Segmentation