paper-with-me

홈 › Papers

Adaptive Embedding Gate for Attention-Based Scene Text Recognition

2019-08-26 · Xiaoxue Chen, Tianwei Wang, Yuanzhi Zhu, Lianwen Jin, Canjie Luo

Scene text recognition has attracted particular research interest because it is a very challenging problem and has various applications. The most cutting-edge methods are attentional encoder-decoder frameworks that learn the alignment between the input image and output sequences. In particular, the decoder recurrently outputs predictions, using the prediction of the previous step as a guidance for every time step. In this study, we point out that the inappropriate use of previous predictions in existing attention mechanisms restricts the recognition performance and brings instability. To handle this problem, we propose a novel module, namely adaptive embedding gate(AEG). The proposed AEG focuses on introducing high-order character language models to attention mechanism by controlling the information transmission between adjacent characters. AEG is a flexible module and can be easily integrated into the state-of-the-art attentional methods. We evaluate its effectiveness as well as robustness on a number of standard benchmarks, including the IIIT$5$K, SVT, SVT-P, CUTE$80$, and ICDAR datasets. Experimental results demonstrate that AEG can significantly boost recognition performance and bring better robustness.

📄 PDF Abstract BibTeX arXiv:1908.09475

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderScene Text Recognition

Similar Papers 제목 키워드 기반

On Geometrical Properties of Text Token Embeddings for Strong Semantic Binding in Text-to-Image Generation

2025-03-29 · Hoigi Seo, Junseo Bang, Haechang Lee, Joohoon Lee 외

Text-to-Image (T2I) models often suffer from text-image misalignment in complex scenes involving multiple objects and attributes. Semantic binding aims to mitigate this issue by accurately associating the generated attri…

Image GenerationText to Image GenerationText-to-Image Generation

Beyond Visual Semantics: Exploring the Role of Scene Text in Image Understanding

2019-05-25 · Arka Ujjal Dey, Suman Kumar Ghosh, Ernest Valveny, Gaurav Harit

Images with visual and scene text content are ubiquitous in everyday life. However, current image interpretation systems are mostly limited to using only the visual features, neglecting to leverage the scene text content…

Retrieval

SACANet: scene-aware class attention network for semantic segmentation of remote sensing images

2023-04-22 · Xiaowen Ma, Rui Che, Tingfeng Hong, Mengting Ma 외

Spatial attention mechanism has been widely used in semantic segmentation of remote sensing images given its capability to model long-range dependencies. Many methods adopting spatial attention mechanism aggregate contex…

Semantic Segmentation

Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis

2026-07-06 · Xianhao Chen, Jiarui Hu, Yuanbo Yang, Xiyu Zhang 외 arxiv

Open-vocabulary 3D scene understanding aims to segment 3D scenes beyond predefined categories by transferring semantic knowledge from vision-language models. Existing methods have advanced this task by lifting language-a…

Scene Understanding

Augmented Transformers with Adaptive n-grams Embedding for Multilingual Scene Text Recognition

2023-02-28 · Xueming Yan, Zhihang Fang, Yaochu Jin

While vision transformers have been highly successful in improving the performance in image-based tasks, not much work has been reported on applying transformers to multilingual scene text recognition due to the complexi…

Language IdentificationScene Text Recognition