Image Retrieval and Pattern Spotting using Siamese Neural Network
This paper presents a novel approach for image retrieval and pattern spotting in document image collections. The manual feature engineering is avoided by learning a similarity-based representation using a Siamese Neural Network trained on a previously prepared subset of image pairs from the ImageNet dataset. The learned representation is used to provide the similarity-based feature maps used to find relevant image candidates in the data collection given an image query. A robust experimental protocol based on the public Tobacco800 document image collection shows that the proposed method compares favorably against state-of-the-art document image retrieval methods, reaching 0.94 and 0.83 of mean average precision (mAP) for retrieval and pattern spotting (IoU=0.7), respectively. Besides, we have evaluated the proposed method considering feature maps of different sizes, showing the impact of reducing the number of features in the retrieval performance and time-consuming.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature EngineeringImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
Deep Learning Approaches for Image Retrieval and Pattern Spotting in Ancient Documents
This paper describes two approaches for content-based image retrieval and pattern spotting in document images using deep learning. The first approach uses a pre-trained CNN model to cope with the lack of training data, w…
Content-Based Image RetrievalImage RetrievalRetrievalPattern Spotting and Image Retrieval in Historical Documents using Deep Hashing
This paper presents a deep learning approach for image retrieval and pattern spotting in digital collections of historical documents. First, a region proposal algorithm detects object candidates in the document page imag…
Deep HashingImage RetrievalRegion ProposalRetrievalLocal Binary Pattern for Word Spotting in Handwritten Historical Document
Digital libraries store images which can be highly degraded and to index this kind of images we resort to word spot- ting as our information retrieval system. Information retrieval for handwritten document images is more…
Information RetrievalRetrievaliDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents
Considering the imminent massification of digital books, it has become critical to facilitate searching collections through graphical patterns. Current strategies for document retrieval and pattern spotting in historical…
Learning to Rank Words: Optimizing Ranking Metrics for Word Spotting
In this paper, we explore and evaluate the use of ranking-based objective functions for learning simultaneously a word string and a word image encoder. We consider retrieval frameworks in which the user expects a retriev…
Learning-To-RankRetrieval