Robust Scene Text Recognition with Automatic Rectification
Recognizing text in natural images is a challenging task with many unsolved problems. Different from those in documents, words in natural images often possess irregular shapes, which are caused by perspective distortion, curved character placement, etc. We propose RARE (Robust text recognizer with Automatic REctification), a recognition model that is robust to irregular text. RARE is a specially-designed deep neural network, which consists of a Spatial Transformer Network (STN) and a Sequence Recognition Network (SRN). In testing, an image is firstly rectified via a predicted Thin-Plate-Spline (TPS) transformation, into a more "readable" image for the following SRN, which recognizes text through a sequence recognition approach. We show that the model is able to recognize several types of irregular text, including perspective text and curved text. RARE is end-to-end trainable, requiring only images and associated text labels, making it convenient to train and deploy the model in practical systems. State-of-the-art or highly-competitive performance achieved on several benchmarks well demonstrates the effectiveness of the proposed model.
Code (5)
Tasks
Optical Character Recognition (OCR)Scene Text DetectionScene Text RecognitionSimilar Papers 제목 키워드 기반
Scene Text Recognition With Finer Grid Rectification
Scene Text Recognition is a challenging problem because of irregular styles and various distortions. This paper proposed an end-to-end trainable model consists of a finer rectification module and a bidirectional attentio…
DecoderScene Text RecognitionESIR: End-to-end Scene Text Recognition via Iterative Image Rectification
Automated recognition of texts in scenes has been a research challenge for years, largely due to the arbitrary variation of text appearances in perspective distortion, text line curvature, text styles and different types…
Scene Text RecognitionA Multi-Object Rectified Attention Network for Scene Text Recognition
Irregular text is widely used. However, it is considerably difficult to recognize because of its various shapes and distorted patterns. In this paper, we thus propose a multi-object rectified attention network (MORAN) fo…
DecoderObjectOptical Character Recognition (OCR)Scene Text RecognitionPortmanteauing Features for Scene Text Recognition
Scene text images have different shapes and are subjected to various distortions, e.g. perspective distortions. To handle these challenges, the state-of-the-art methods rely on a rectification network, which is connected…
Scene Text RecognitionSymmetry-constrained Rectification Network for Scene Text Recognition
Reading text in the wild is a very challenging task due to the diversity of text instances and the complexity of natural scenes. Recently, the community has paid increasing attention to the problem of recognizing text in…
DiversityScene Text Recognition