Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies
Handwritten Text Recognition (HTR) models trained on synthetic handwriting often struggle to generalize to real text, and existing adaptation methods still require real samples from the target domain. In this work, we tackle the fully zero-shot synthetic-to-real generalization setting, where no real data from the target language is available. Our approach learns how model parameters change when moving from synthetic to real handwriting in one or more source languages and transfers this learned correction to new target languages. When using multiple sources, we rely on linguistic similarity to weigh their contrubition when combining them. Experiments across five languages and six architectures show consistent improvements over synthetic-only baselines and reveal that the transferred corrections benefit even languages unrelated to the sources.
Code (0)
등록된 구현이 없습니다.
Tasks
Handwritten Text RecognitionSimilar Papers 제목 키워드 기반
Zero-shot Generation of Training Data with Denoising Diffusion Probabilistic Model for Handwritten Chinese Character Recognition
There are more than 80,000 character categories in Chinese while most of them are rarely used. To build a high performance handwritten Chinese character recognition (HCCR) system supporting the full character set with a …
DenoisingPho(SC)-CTC -- A Hybrid Approach Towards Zero-shot Word Image Recognition
Annotating words in a historical document image archive for word image recognition purpose demands time and skilled human resource (like historians, paleographers). In a real-life scenario, obtaining sample images for al…
Zero-Shot LearningZero-Shot Styled Text Image Generation, but Make It Autoregressive
Styled Handwritten Text Generation (HTG) has recently received attention from the computer vision and document analysis communities, which have developed several solutions, either GAN- or diffusion-based, that achieved p…
Image GenerationText GenerationText-guided Synthetic Geometric Augmentation for Zero-shot 3D Understanding
Zero-shot recognition models require extensive training data for generalization. However, in zero-shot 3D classification, collecting 3D data and captions is costly and laborintensive, posing a significant barrier compare…
3D ClassificationZero-shot 3D classificationZero-Shot LearningGANwriting: Content-Conditioned Generation of Styled Handwritten Word Images
Although current image generation methods have reached impressive quality levels, they are still unable to produce plausible yet diverse images of handwritten words. On the contrary, when writing by hand, a great variabi…
Handwritten Word GenerationImage Generation