paper-with-me

홈 › Papers

Rethinking Text Line Recognition Models

2021-04-15 · Daniel Hernandez Diaz, Siyang Qin, Reeve Ingle, Yasuhisa Fujii, Alessandro Bissacco

In this paper, we study the problem of text line recognition. Unlike most approaches targeting specific domains such as scene-text or handwritten documents, we investigate the general problem of developing a universal architecture that can extract text from any image, regardless of source or input modality. We consider two decoder families (Connectionist Temporal Classification and Transformer) and three encoder modules (Bidirectional LSTMs, Self-Attention, and GRCLs), and conduct extensive experiments to compare their accuracy and performance on widely used public datasets of scene and handwritten text. We find that a combination that so far has received little attention in the literature, namely a Self-Attention encoder coupled with the CTC decoder, when compounded with an external language model and trained on both public and internal data, outperforms all the others in accuracy and computational complexity. Unlike the more common Transformer-based models, this architecture can handle inputs of arbitrary length, a requirement for universal line recognition. Using an internal dataset collected from multiple sources, we also expose the limitations of current public datasets in evaluating the accuracy of line recognizers, as the relatively narrow image width and sequence length distributions do not allow to observe the quality degradation of the Transformer approach when applied to the transcription of long lines.

📄 PDF Abstract BibTeX arXiv:2104.07787

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderHandwritten Text RecognitionLanguage Modelling

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Rethinking Irregular Scene Text Recognition

2019-08-30 · Shangbang Long, Yushuo Guan, Bingxuan Wang, Kaigui Bian 외

Reading text from natural images is challenging due to the great variety in text font, color, size, complex background and etc.. The perspective distortion and non-linear spatial arrangement of characters make it further…

Scene Text Detection

Rethinking of Pedestrian Attribute Recognition: Realistic Datasets with Efficient Method

2020-05-25 · Jian Jia, Houjing Huang, Wenjie Yang, Xiaotang Chen 외

Despite various methods are proposed to make progress in pedestrian attribute recognition, a crucial problem on existing datasets is often neglected, namely, a large number of identical pedestrian identities in train and…

AttributePedestrian Attribute Recognition

Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving

2026-07-02 · Ruchao Fan, Yiming Wang, Rui Zhao, Liliang Ren 외 arxiv

Speech-LLM integration has shown promising results by leveraging extensive textual pretraining, yet its specific benefits for automatic speech recognition (ASR) remain unclear. We observe that as supervised ASR training …

Question AnsweringSpeech RecognitionDomain Adaptation

Rethinking of Pedestrian Attribute Recognition: A Reliable Evaluation under Zero-Shot Pedestrian Identity Setting

2021-07-08 · Jian Jia, Houjing Huang, Xiaotang Chen, Kaiqi Huang

Pedestrian attribute recognition aims to assign multiple attributes to one pedestrian image captured by a video surveillance camera. Although numerous methods are proposed and make tremendous progress, we argue that it i…

AttributePedestrian Attribute Recognition

Toward Reasoning-Centric Time-Series Analysis

2025-10-14 · Xinlei Wang, Mingtian Tan, Jing Qiu, Junhua Zhao 외 arxiv

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected e…

Time Series Analysis