Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering
The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better understanding and interaction with Urdu-language visual data. This initiative seeks to bridge the gap between textual and visual comprehension. We propose a new multi-task Urdu scene text dataset comprising over 1000 natural scene images, which can be used for text detection, recognition, and VQA tasks. We provide fine-grained annotations for text instances, addressing the limitations of previous datasets for facing arbitrary-shaped texts. By incorporating additional annotation points, this dataset facilitates the development and assessment of methods that can handle diverse text layouts, intricate shapes, and non-standard orientations commonly encountered in real-world scenarios. Besides, the VQA annotations make it the first benchmark for the Urdu Text VQA method, which can prompt the development of Urdu scene text understanding. The proposed dataset is available at: https://github.com/Hiba-MeiRuan/Urdu-VQA-Dataset-/tree/main
Code (1)
Tasks
DiversityInformation RetrievalQuestion AnsweringRetrievalScene Text DetectionText DetectionVisual Question AnsweringVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
Urdu text in natural scene images: a new dataset and preliminary text detection
Text detection in natural scene images for content analysis is an interesting task. The research community has seen some great developments for English/Mandarin text detection. However, Urdu text extraction in natural sc…
Text DetectionA Benchmark Dataset and a Framework for Urdu Multimodal Named Entity Recognition
The emergence of multimodal content, particularly text and images on social media, has positioned Multimodal Named Entity Recognition (MNER) as an increasingly important area of research within Natural Language Processin…
named-entity-recognitionNamed Entity RecognitionA Precisely Xtreme-Multi Channel Hybrid Approach For Roman Urdu Sentiment Analysis
In order to accelerate the performance of various Natural Language Processing tasks for Roman Urdu, this paper for the very first time provides 3 neural word embeddings prepared using most widely used approaches namely W…
Deep LearningSentiment AnalysisWord EmbeddingsUTRNet: High-Resolution Urdu Text Recognition In Printed Documents
In this paper, we propose a novel approach to address the challenges of printed Urdu text recognition using high-resolution, multi-scale semantic feature extraction. Our proposed UTRNet architecture, a hybrid CNN-RNN mod…
Line DetectionOptical Character Recognition (OCR)Printed Text RecognitionText DetectionLeveraging machine learning for less developed languages: Progress on Urdu text detection
Text detection in natural scene images has applications for autonomous driving, navigation help for elderly and blind people. However, the research on Urdu text detection is usually hindered by lack of data resources. We…
Autonomous DrivingText Detection