GTC: Guided Training of CTC Towards Efficient and Accurate Scene Text Recognition
Connectionist Temporal Classification (CTC) and attention mechanism are two main approaches used in recent scene text recognition works. Compared with attention-based methods, CTC decoder has a much shorter inference time, yet a lower accuracy. To design an efficient and effective model, we propose the guided training of CTC (GTC), where CTC model learns a better alignment and feature representations from a more powerful attentional guidance. With the benefit of guided training, CTC model achieves robust and accurate prediction for both regular and irregular scene text while maintaining a fast inference speed. Moreover, to further leverage the potential of CTC decoder, a graph convolutional network (GCN) is proposed to learn the local correlations of extracted features. Extensive experiments on standard benchmarks demonstrate that our end-to-end model achieves a new state-of-the-art for regular and irregular scene text recognition and needs 6 times shorter inference time than attentionbased methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderScene Text RecognitionSimilar Papers 제목 키워드 기반
A Holistic Representation Guided Attention Network for Scene Text Recognition
Reading irregular scene text of arbitrary shape in natural images is still a challenging problem, despite the progress made recently. Many existing approaches incorporate sophisticated network structures to handle variou…
DecoderIrregular Text RecognitionScene Text RecognitionRecognition-Guided Diffusion Model for Scene Text Image Super-Resolution
Scene Text Image Super-Resolution (STISR) aims to enhance the resolution and legibility of text within low-resolution (LR) images, consequently elevating recognition accuracy in Scene Text Recognition (STR). Previous met…
DenoisingDiversityImage Super-ResolutionScene Text Recognition+1Text Prior Guided Scene Text Image Super-resolution
Scene text image super-resolution (STISR) aims to improve the resolution and visual quality of low-resolution (LR) scene text images, and consequently boost the performance of text recognition. However, most of existing …
Image Super-ResolutionSuper-ResolutionDictionary-Guided Scene Text Recognition
Language prior plays an important role in the way humans perceive and recognize text in the wild. In this work, we present an approach to train and use scene text recognition models by exploiting multiple clues from …
Scene Text DetectionScene Text RecognitionText DetectionText SpottingInstruction-Guided Scene Text Recognition
Multi-modal models have shown appealing performance in visual recognition tasks, as free-form text-guided training evokes the ability to understand fine-grained visual content. However, current models cannot be trivially…
Question AnsweringScene Text Recognition