A Few Shot Multi-Representation Approach for N-gram Spotting in Historical Manuscripts
Despite recent advances in automatic text recognition, the performance remains moderate when it comes to historical manuscripts. This is mainly because of the scarcity of available labelled data to train the data-hungry Handwritten Text Recognition (HTR) models. The Keyword Spotting System (KWS) provides a valid alternative to HTR due to the reduction in error rate, but it is usually limited to a closed reference vocabulary. In this paper, we propose a few-shot learning paradigm for spotting sequences of a few characters (N-gram) that requires a small amount of labelled training data. We exhibit that recognition of important n-grams could reduce the system's dependency on vocabulary. In this case, an out-of-vocabulary (OOV) word in an input handwritten line image could be a sequence of n-grams that belong to the lexicon. An extensive experimental evaluation of our proposed multi-representation approach was carried out on a subset of Bentham's historical manuscript collections to obtain some really promising results in this direction.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningHandwritten Text RecognitionHTRKeyword SpottingvalidSimilar Papers 제목 키워드 기반
Radial Line Fourier Descriptor for Historical Handwritten Text Representation
Automatic recognition of historical handwritten manuscripts is a daunting task due to paper degradation over time. Recognition-free retrieval or word spotting is popularly used for information retrieval and digitization …
Information RetrievalRetrievalST-KeyS: Self-Supervised Transformer for Keyword Spotting in Historical Handwritten Documents
Keyword spotting (KWS) in historical documents is an important tool for the initial exploration of digitized collections. Nowadays, the most efficient KWS methods are relying on machine learning techniques that require a…
Keyword SpottingSelf-Supervised LearningPattern Spotting and Image Retrieval in Historical Documents using Deep Hashing
This paper presents a deep learning approach for image retrieval and pattern spotting in digital collections of historical documents. First, a region proposal algorithm detects object candidates in the document page imag…
Deep HashingImage RetrievalRegion ProposalRetrievalFrom Skeletons to Pixels: Few-Shot Precise Event Spotting via Representation and Prediction Distillation
Precise Event Spotting (PES) is essential in fast-paced sports such as tennis, where fine-grained events occur within very short temporal windows. Accurate frame-level localization is challenging because of motion blur, …
Query by String word spotting based on character bi-gram indexing
In this paper we propose a segmentation-free query by string word spotting method. Both the documents and query strings are encoded using a recently proposed word representa- tion that projects images and strings into a …
AttributeRe-RankingRetrievalSegmentation