paper-with-me

홈 › Papers

TiCLS : Tightly Coupled Language Text Spotter

2026-02-03 · Leeje Jang, Yijun Lin, Yao-Yi Chiang, Jerod Weinman arxiv

Scene text spotting aims to detect and recognize text in real-world images, where instances are often short, fragmented, or visually ambiguous. Existing methods primarily rely on visual cues and implicitly capture local character dependencies, but they overlook the benefits of external linguistic knowledge. Prior attempts to integrate language models either adapt language modeling objectives without external knowledge or apply pretrained models that are misaligned with the word-level granularity of scene text. We propose TiCLS, an end-to-end text spotter that explicitly incorporates external linguistic knowledge from a character-level pretrained language model. TiCLS introduces a linguistic decoder that fuses visual and linguistic features, yet can be initialized by a pretrained language model, enabling robust recognition of ambiguous or fragmented text. Experiments on ICDAR 2015 and Total-Text demonstrate that TiCLS achieves state-of-the-art performance, validating the effectiveness of PLM-guided linguistic integration for scene text spotting.

📄 PDF Abstract BibTeX arXiv:2602.04030

Code (0)

등록된 구현이 없습니다.

Tasks

Text Spotting

Similar Papers 제목 키워드 기반

Using an LLM to Turn Sign Spottings into Spoken Language Sentences

2024-03-15 · Ozge Mercanoglu Sincan, Necati Cihan Camgoz, Richard Bowden

Sign Language Translation (SLT) is a challenging task that aims to generate spoken language sentences from sign language videos. In this paper, we introduce a hybrid SLT approach, Spotter+GPT, that utilizes a sign spotte…

Language ModelingLanguage ModellingLarge Language ModelSign Language Translation+1

Single Shot Self-Reliant Scene Text Spotter by Decoupled yet Collaborative Detection and Recognition

2022-07-15 · Jingjing Wu, Pengyuan Lyu, Guangming Lu, Chengquan Zhang 외

Typical text spotters follow the two-stage spotting paradigm which detects the boundary for a text instance first and then performs text recognition within the detected regions. Despite the remarkable progress of such sp…

Text DetectionText Spotting

AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting

2020-08-03 · ECCV 2020 8 · Wenhai Wang, Xuebo Liu, Xiaozhong Ji, Enze Xie 외

Scene text spotting aims to detect and recognize the entire word or sentence with multiple characters in natural images. It is still challenging because ambiguity often occurs when the spacing between characters is large…

Language ModellingSentenceText DetectionText Spotting

Character Region Attention For Text Spotting

2020-07-19 · ECCV 2020 8 · Youngmin Baek, Seung Shin, Jeonghun Baek, Sungrae Park 외

A scene text spotter is composed of text detection and recognition modules. Many studies have been conducted to unify these modules into an end-to-end trainable model to achieve better performance. A typical architecture…

DecoderText DetectionText Spotting

TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model

2024-03-15 · Jiahao Lyu, Jin Wei, Gangyan Zeng, Zeng Li 외

Existing scene text spotters are designed to locate and transcribe texts from images. However, it is challenging for a spotter to achieve precise detection and recognition of scene texts simultaneously. Inspired by the g…

Language ModelingLanguage ModellingOptical Character Recognition (OCR)Scene Recognition+2