paper-with-me

Papers

FETNet: Feature Erasing and Transferring Network for Scene Text Removal

2023-06-16 · Guangtao Lyu, Kun Liu, Anna Zhu, Seiichi Uchida, Brian Kenji Iwana

The scene text removal (STR) task aims to remove text regions and recover the background smoothly in images for private information protection. Most existing STR methods adopt encoder-decoder-based CNNs, with direct copies of the features in the skip connections. However, the encoded features contain both text texture and structure information. The insufficient utilization of text features hampers the performance of background reconstruction in text removal regions. To tackle these problems, we propose a novel Feature Erasing and Transferring (FET) mechanism to reconfigure the encoded features for STR in this paper. In FET, a Feature Erasing Module (FEM) is designed to erase text features. An attention module is responsible for generating the feature similarity guidance. The Feature Transferring Module (FTM) is introduced to transfer the corresponding features in different layers based on the attention guidance. With this mechanism, a one-stage, end-to-end trainable network called FETNet is constructed for scene text removal. In addition, to facilitate research on both scene text removal and segmentation tasks, we introduce a novel dataset, Flickr-ST, with multi-category annotations. A sufficient number of experiments and ablation studies are conducted on the public datasets and Flickr-ST. Our proposed method achieves state-of-the-art performance using most metrics, with remarkably higher quality scene text removal results. The source code of our work is available at: \href{https://github.com/GuangtaoLyu/FETNet}{https://github.com/GuangtaoLyu/FETNet.

📄 PDF Abstract BibTeX arXiv:2306.09593

Code (1)

guangtaolyu/fetnet 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Progressive Scene Text Erasing with Self-Supervision

2022-07-23 · Xiangcheng Du, Zhao Zhou, Yingbin Zheng, Xingjiao Wu 외

Scene text erasing seeks to erase text contents from scene images and current state-of-the-art text erasing models are trained on large-scale synthetic data. Although data synthetic engines can provide vast amounts of an…

NETNet: Neighbor Erasing and Transferring Network for Better Single Shot Object Detection

2020-01-18 · CVPR 2020 6 · Yazhao Li, Yanwei Pang, Jianbing Shen, Jiale Cao 외

Due to the advantages of real-time detection and improved performance, single-shot detectors have gained great attention recently. To solve the complex scale variations, single-shot detectors make scale-aware predictions…

Objectobject-detectionObject Detection

Scene Text Eraser

2017-05-08 · Toshiki Nakamura, Anna Zhu, Keiji Yanai, Seiichi Uchida

The character information in natural scene images contains various personal information, such as telephone numbers, home addresses, etc. It is a high risk of leakage the information if they are published. In this paper, …

Scene Text DetectionText Detection

Stroke-Based Scene Text Erasing Using Synthetic Data for Training

2021-04-23 · Zhengmi Tang, Tomo Miyazaki, Yoshihiro Sugaya, Shinichiro Omachi

Scene text erasing, which replaces text regions with reasonable content in natural images, has drawn significant attention in the computer vision community in recent years. There are two potential subtasks in scene text …

Image InpaintingText Detection

Scene Text Magnifier

2019-06-17 · Toshiki Nakamura, Anna Zhu, Seiichi Uchida

Scene text magnifier aims to magnify text in natural scene images without recognition. It could help the special groups, who have myopia or dyslexia to better understand the scene. In this paper, we design the scene text…

Image Generationtext annotation