Context-Free TextSpotter for Real-Time and Mobile End-to-End Text Detection and Recognition
In the deployment of scene-text spotting systems on mobile platforms, lightweight models with low computation are preferable. In concept, end-to-end (E2E) text spotting is suitable for such purposes because it performs text detection and recognition in a single model. However, current state-of-the-art E2E methods rely on heavy feature extractors, recurrent sequence modellings, and complex shape aligners to pursue accuracy, which means their computations are still heavy. We explore the opposite direction: How far can we go without bells and whistles in E2E text spotting? To this end, we propose a text-spotting method that consists of simple convolutions and a few post-processes, named Context-Free TextSpotter. Experiments using standard benchmarks show that Context-Free TextSpotter achieves real-time text spotting on a GPU with only three million parameters, which is the smallest and fastest among existing deep text spotters, with an acceptable transcription quality degradation compared to heavier ones. Further, we demonstrate that our text spotter can run on a smartphone with affordable latency, which is valuable for building stand-alone OCR applications.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUOptical Character Recognition (OCR)Text DetectionText SpottingSimilar Papers 제목 키워드 기반
Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting
Recent end-to-end trainable methods for scene text spotting, integrating detection and recognition, showed much progress. However, most of the current arbitrary-shape scene text spotters use region proposal networks (RPN…
Region ProposalText SpottingFastTextSpotter: A High-Efficiency Transformer for Multilingual Scene Text Spotting
The proliferation of scene text in both structured and unstructured environments presents significant challenges in optical character recognition (OCR), necessitating more efficient and robust text spotting solutions. Th…
BenchmarkingDecoderOptical Character RecognitionOptical Character Recognition (OCR)+1AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting
Scene text spotting aims to detect and recognize the entire word or sentence with multiple characters in natural images. It is still challenging because ambiguity often occurs when the spacing between characters is large…
Language ModellingSentenceText DetectionText SpottingSwinTextSpotter v2: Towards Better Synergy for Scene Text Spotting
End-to-end scene text spotting, which aims to read the text in natural images, has garnered significant attention in recent years. However, recent state-of-the-art methods usually incorporate detection and recognition si…
Text DetectionText SpottingSwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition
End-to-end scene text spotting has attracted great attention in recent years due to the success of excavating the intrinsic synergy of the scene text detection and recognition. However, recent state-of-the-art methods us…
Scene Text DetectionText DetectionText Spotting