paper-with-me

홈 › Papers

ESTISR: Adapting Efficient Scene Text Image Super-resolution for Real-Scenes

2023-06-04 · Minghao Fu, Xin Man, Yihan Xu, Jie Shao

While scene text image super-resolution (STISR) has yielded remarkable improvements in accurately recognizing scene text, prior methodologies have placed excessive emphasis on optimizing performance, rather than paying due attention to efficiency - a crucial factor in ensuring deployment of the STISR-STR pipeline. In this work, we propose a novel Efficient Scene Text Image Super-resolution (ESTISR) Network for resource-limited deployment platform. ESTISR's functionality primarily depends on two critical components: a CNN-based feature extractor and an efficient self-attention mechanism used for decoding low-resolution images. We designed a re-parameterized inverted residual block specifically suited for resource-limited circumstances as the feature extractor. Meanwhile, we proposed a novel self-attention mechanism, softmax shrinking, based on a kernel-based approach. This innovative technique offers linear complexity while also naturally incorporating discriminating low-level features into the self-attention structure. Extensive experiments on TextZoom show that ESTISR retains a high image restoration quality and improved STR accuracy of low-resolution images. Furthermore, ESTISR consistently outperforms current methods in terms of actual running time and peak memory consumption, while achieving a better trade-off between performance and efficiency.

📄 PDF Abstract BibTeX arXiv:2306.02443

Code (0)

등록된 구현이 없습니다.

Tasks

Image RestorationImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Batch Normalization 설명 없음
Residual Connection 설명 없음
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…

Similar Papers 제목 키워드 기반

WeText: Scene Text Detection under Weak Supervision

2017-10-13 · ICCV 2017 10 · Shangxuan Tian, Shijian Lu, Chongshou Li

The requiring of large amounts of annotated training data has become a common constraint on various deep learning systems. In this paper, we propose a weakly supervised scene text detection method (WeText) that trains ro…

Scene Text DetectionText DetectionWeakly-supervised Learning

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

2023-08-25 · Yibo Wang, Yunhu Ye, Yuanpeng Mao, Yanwei Yu 외

Text segmentation tasks have a very wide range of application values, such as image editing, style transfer, watermark removal, etc.However, existing public datasets are of poor quality of pixel-level labels that have be…

SegmentationStyle TransferText Segmentation

StyleCity: Large-Scale 3D Urban Scenes Stylization

2024-04-16 · Yingshu Chen, Huajian Huang, Tuan-Anh Vu, Ka Chun Shum 외

Creating large-scale virtual urban scenes with variant styles is inherently challenging. To facilitate prototypes of virtual production and bypass the need for complex materials and lighting setups, we introduce the firs…

Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors

2022-03-24 · Oran Gafni, Adam Polyak, Oron Ashual, Shelly Sheynin 외

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy,…

Image GenerationSemantic SegmentationText to Image GenerationText-to-Image Generation

CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation

2023-09-21 · NeurIPS 2023 11

Existing methods for adapting Neural Radiance Fields (NeRFs) to scene changes require extensive data capture and model retraining, which is both time-consuming and labor-intensive. In this paper, we tackle the challenge …