TextDragon: An End-to-End Framework for Arbitrary Shaped Text Spotting
Most existing text spotting methods either focus on horizontal/oriented texts or perform arbitrary shaped text spotting with character-level annotations. In this paper, we propose a novel text spotting framework to detect and recognize text of arbitrary shapes in an end-to-end manner, using only word/line-level annotations for training. Motivated from the name of TextSnake, which is only a detection model, we call the proposed text spotting framework TextDragon. In TextDragon, a text detector is designed to describe the shape of text with a series of quadrangles, which can handle text of arbitrary shapes. To extract arbitrary text regions from feature maps, we propose a new differentiable operator named RoISlide, which is the key to connect arbitrary shaped text detection and recognition. Based on the extracted features through RoISlide, a CNN and CTC based text recognizer is introduced to make the framework free from labeling the location of characters. The proposed method achieves state-of-the-art performance on two curved text benchmarks CTW1500 and Total-Text, and competitive results on the ICDAR 2015 Dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Text DetectionText SpottingSimilar Papers 제목 키워드 기반
A Feasible Framework for Arbitrary-Shaped Scene Text Recognition
Deep learning based methods have achieved surprising progress in Scene Text Recognition (STR), one of classic problems in computer vision. In this paper, we propose a feasible framework for multi-lingual arbitrary-shaped…
Instance SegmentationLanguage ModelingLanguage ModellingScene Text Recognition+3DEER: Detection-agnostic End-to-End Recognizer for Scene Text Spotting
Recent end-to-end scene text spotters have achieved great improvement in recognizing arbitrary-shaped text instances. Common approaches for text spotting use region of interest pooling or segmentation masks to restrict f…
DecoderText SpottingLRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spotting
End-to-end text spotting aims to jointly optimize text detection and recognition within a unified framework. Despite significant progress, designing an accurate and efficient end-to-end text spotter for arbitrary-shaped …
Text DetectionText SpottingAll You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting
Recently, end-to-end text spotting that aims to detect and recognize text from cluttered images simultaneously has received particularly growing interest in computer vision. Different from the existing approaches that fo…
AllInstance SegmentationScene Text DetectionSemantic Segmentation+2Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting
Many approaches have recently been proposed to detect irregular scene text and achieved promising results. However, their localization results may not well satisfy the following text recognition part mainly because of tw…
global-optimizationText DetectionText Spotting