Efficient and Accurate Scene Text Recognition with Cascaded-Transformers
In recent years, vision transformers with text decoder have demonstrated remarkable performance on Scene Text Recognition (STR) due to their ability to capture long-range dependencies and contextual relationships with high learning capacity. However, the computational and memory demands of these models are significant, limiting their deployment in resource-constrained applications. To address this challenge, we propose an efficient and accurate STR system. Specifically, we focus on improving the efficiency of encoder models by introducing a cascaded-transformers structure. This structure progressively reduces the vision token size during the encoding step, effectively eliminating redundant tokens and reducing computational cost. Our experimental results confirm that our STR system achieves comparable performance to state-of-the-art baselines while substantially decreasing computational requirements. In particular, for large-models, the accuracy remains same, 92.77 to 92.68, while computational complexity is almost halved with our structure.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderScene Text RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Accurate Facial Landmark Detection via Cascaded Transformers
Accurate facial landmarks are essential prerequisites for many tasks related to human faces. In this paper, an accurate facial landmark detector is proposed based on cascaded transformers. We formulate facial landmark de…
DecoderFace AlignmentFacial Landmark DetectionI2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition
Leveraging the advances of natural language processing, most recent scene text recognizers adopt an encoder-decoder architecture where text images are first converted to representative features and then a sequence of cha…
DecoderScene Text RecognitionAttribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning
This paper presents new hierarchically cascaded transformers that can improve data efficiency through attribute surrogates learning and spectral tokens pooling. Vision transformers have recently been thought of as a prom…
AttributeFew-Shot Image ClassificationFew-Shot LearningSelf-Supervised LearningMulti-Scale FCN With Cascaded Instance Aware Segmentation for Arbitrary Oriented Word Spotting in the Wild
Scene text detection has attracted great attention these years. Text potentially exist in a wide variety of images or videos and play an important role in understanding the scene. In this paper, we present a novel t…
Scene Text DetectionText DetectionCascaded Scene Flow Prediction using Semantic Segmentation
Given two consecutive frames from a pair of stereo cameras, 3D scene flow methods simultaneously estimate the 3D geometry and motion of the observed scene. Many existing approaches use superpixels for regularization, but…
3D geometryAutonomous DrivingGeneral ClassificationOptical Flow Estimation+3