paper-with-me

Papers

CentripetalText: An Efficient Text Instance Representation for Scene Text Detection

2021-07-13 · NeurIPS 2021 12 · Tao Sheng, Jie Chen, Zhouhui Lian

Scene text detection remains a grand challenge due to the variation in text curvatures, orientations, and aspect ratios. One of the hardest problems in this task is how to represent text instances of arbitrary shapes. Although many methods have been proposed to model irregular texts in a flexible manner, most of them lose simplicity and robustness. Their complicated post-processings and the regression under Dirac delta distribution undermine the detection performance and the generalization ability. In this paper, we propose an efficient text instance representation named CentripetalText (CT), which decomposes text instances into the combination of text kernels and centripetal shifts. Specifically, we utilize the centripetal shifts to implement pixel aggregation, guiding the external text pixels to the internal text kernels. The relaxation operation is integrated into the dense regression for centripetal shifts, allowing the correct prediction in a range instead of a specific value. The convenient reconstruction of text contours and the tolerance of prediction errors in our method guarantee the high detection accuracy and the fast inference speed, respectively. Besides, we shrink our text detector into a proposal generation module, namely CentripetalText Proposal Network, replacing Segmentation Proposal Network in Mask TextSpotter v3 and producing more accurate proposals. To validate the effectiveness of our method, we conduct experiments on several commonly used scene text benchmarks, including both curved and multi-oriented text datasets. For the task of scene text detection, our approach achieves superior or competitive performance compared to other existing methods, e.g., F-measure of 86.3% at 40.0 FPS on Total-Text, F-measure of 86.1% at 34.8 FPS on MSRA-TD500, etc. For the task of end-to-end scene text recognition, our method outperforms Mask TextSpotter v3 by 1.1% on Total-Text.

📄 PDF Abstract BibTeX arXiv:2107.05945

Code (1)

shengtao96/centripetaltext 공식 구현 pytorch

Tasks

regressionScene Text DetectionScene Text RecognitionText Detection

Similar Papers 제목 키워드 기반

IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection

2024-03-22 · CVPR 2024 1 · Junbo Yin, Jianbing Shen, Runnan Chen, Wei Li 외

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associate…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection

Unambiguous Text Localization and Retrieval for Cluttered Scenes

2017-07-01 · CVPR 2017 7 · Xuejian Rong, Chucai Yi, YingLi Tian

Text instance as one category of self-described objects provides valuable information for understanding and describing cluttered scenes. In this paper, we explore the task of unambiguous text localization and retrieval, …

RetrievalText Retrieval

Geometry-Aware Scene Text Detection With Instance Transformation Network

2018-06-01 · CVPR 2018 6 · Fangfang Wang, Liming Zhao, Xi Li, Xinchao Wang 외

Localizing text in the wild is challenging in the situations of complicated geometric layout of the targets like random orientation and large aspect ratio. In this paper, we propose a geometry-aware modeling approach tai…

General ClassificationMulti-Task LearningregressionScene Text Detection+3

CORE-Text: Improving Scene Text Detection with Contrastive Relational Reasoning

2021-12-14 · Jingyang Lin, Yingwei Pan, Rongfeng Lai, Xuehang Yang 외

Localizing text instances in natural scenes is regarded as a fundamental challenge in computer vision. Nevertheless, owing to the extremely varied aspect ratios and scales of text instances in real scenes, most conventio…

RelationRelational ReasoningScene Text DetectionText Detection

Learning Instance Representation Banks for Aerial Scene Classification

2022-05-27 · Jingjun Yi, Beichen Zhou

Aerial scenes are more complicated in terms of object distribution and spatial arrangement than natural scenes due to the bird view, and thus remain challenging to learn discriminative scene representation. Recent soluti…

Aerial Scene ClassificationClassificationMultiple Instance LearningScene Classification