paper-with-me

홈 › Papers

Efficiently Leveraging Linguistic Priors for Scene Text Spotting

2024-02-27 · Nguyen Nguyen, Yapeng Tian, Chenliang Xu

Incorporating linguistic knowledge can improve scene text recognition, but it is questionable whether the same holds for scene text spotting, which typically involves text detection and recognition. This paper proposes a method that leverages linguistic knowledge from a large text corpus to replace the traditional one-hot encoding used in auto-regressive scene text spotting and recognition models. This allows the model to capture the relationship between characters in the same word. Additionally, we introduce a technique to generate text distributions that align well with scene text datasets, removing the need for in-domain fine-tuning. As a result, the newly created text distributions are more informative than pure one-hot encoding, leading to improved spotting and recognition performance. Our method is simple and efficient, and it can easily be integrated into existing auto-regressive-based approaches. Experimental results show that our method not only improves recognition accuracy but also enables more accurate localization of words. It significantly improves both state-of-the-art scene text spotting and recognition pipelines, achieving state-of-the-art results on several benchmarks.

📄 PDF Abstract BibTeX arXiv:2402.17134

Code (0)

등록된 구현이 없습니다.

Tasks

Scene Text RecognitionText DetectionText Spotting

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Language-Driven Object-Oriented Two-Stage Method for Scene Graph Anticipation

2025-09-06 · Xiaomeng Zhu, Changwei Wang, Haozhe Wang, Xinyu Liu 외 arxiv

A scene graph is a structured representation of objects and their spatio-temporal relationships in dynamic scenes. Scene Graph Anticipation (SGA) involves predicting future scene graphs from video clips, enabling applica…

Relational Reasoning

Robust Grounding with MLLMs Against Occlusion and Small Objects via Language-Guided Semantic Cues

2026-04-27 · Beomchan Park, Seongho Kim, Hyunjun Kim, Sungjune Park 외 arxiv

While Multimodal Large Language Models (MLLMs) have enhanced grounding capabilities in general scenes, their robustness in crowded scenes remains underexplored. Crowded scenes entail visual challenges (i.e., occlusion an…

PARSE: Part-Aware Relational Spatial Modeling

2026-03-08 · Yinuo Bai, Peijun Xu, Kuixiang Shao, Yuyang Jiao 외 arxiv

Inter-object relations underpin spatial intelligence, yet existing representations -- linguistic prepositions or object-level scene graphs -- are too coarse to specify which regions actually support, contain, or contact …

Spatial Reasoning3D Generation

Vision-Language Guided Hyperspectral Object Tracking via Semantics Fusion and Contextual Template Updating

2026-06-08 · Rui Yao, Yuhong Zhang, Kunyang Sun, Hancheng Zhu 외 arxiv

Hyperspectral object tracking (HOT) leverages the rich spectral information provided by hyperspectral videos (HSVs), offering substantial potential for object tracking. However, efficiently extracting and exploiting spec…

Object Tracking

Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architectures

2025-07-07 · Sudarshan Babu

The ability to transfer knowledge from prior experiences to novel tasks stands as a pivotal capability of intelligent agents, including both humans and computational models. This principle forms the basis of transfer lea…

3D GenerationComputational chemistryMeta-LearningMolecular Property Prediction+4