TextSR: Content-Aware Text Super-Resolution Guided by Recognition
Scene text recognition has witnessed rapid development with the advance of convolutional neural networks. Nonetheless, most of the previous methods may not work well in recognizing text with low resolution which is often seen in natural scene images. An intuitive solution is to introduce super-resolution techniques as pre-processing. However, conventional super-resolution methods in the literature mainly focus on reconstructing the detailed texture of natural images, which typically do not work well for text due to the unique characteristics of text. To tackle these problems, in this work, we propose a content-aware text super-resolution network to generate the information desired for text recognition. In particular, we design an end-to-end network that can perform super-resolution and text recognition simultaneously. Different from previous super-resolution methods, we use the loss of text recognition as the Text Perceptual Loss to guide the training of the super-resolution network, and thus it pays more attention to the text content, rather than the irrelevant background area. Extensive experiments on several challenging benchmarks demonstrate the effectiveness of our proposed method in restoring a sharp high-resolution image from a small blurred one, and show that the recognition performance clearly boosts up the performance of text recognizer. To our knowledge, this is the first work focusing on text super-resolution. Code will be released in https://github.com/xieenze/TextSR.
Code (1)
Tasks
Scene Text RecognitionSuper-ResolutionSimilar Papers 제목 키워드 기반
TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
While recent advancements in Image Super-Resolution (SR) using diffusion models have shown promise in improving overall image quality, their application to scene text images has revealed limitations. These models often s…
Image Super-ResolutionOptical Character RecognitionOptical Character Recognition (OCR)Super-Resolution+1Boosting Optical Character Recognition: A Super-Resolution Approach
Text image super-resolution is a challenging yet open research problem in the computer vision community. In particular, low-resolution images hamper the performance of typical optical character recognition (OCR) systems.…
Image Super-ResolutionOptical Character RecognitionOptical Character Recognition (OCR)Super-ResolutionOn-Device Text Image Super Resolution
Recent research on super-resolution (SR) has witnessed major developments with the advancements of deep convolutional neural networks. There is a need for information extraction from scenic text images or even document i…
Cloud ComputingGPUImage Super-ResolutionOptical Character Recognition (OCR)+1Scene Text Image Super-Resolution via Content Perceptual Loss and Criss-Cross Transformer Blocks
Text image super-resolution is a unique and important task to enhance readability of text images to humans. It is widely used as pre-processing in scene text recognition. However, due to the complex degradation in natura…
Image ReconstructionImage Super-ResolutionScene Text RecognitionSuper-ResolutionScene Text Telescope: Text-Focused Scene Image Super-Resolution
Image super-resolution, which is often regarded as a preprocessing procedure of scene text recognition, aims to recover the realistic features from a low-resolution text image. It has always been challenging due to l…
Image Super-ResolutionOptical Character Recognition (OCR)PositionScene Text Recognition+1