Towards Writer Retrieval for Historical Datasets
This paper presents an unsupervised approach for writer retrieval based on clustering SIFT descriptors detected at keypoint locations resulting in pseudo-cluster labels. With those cluster labels, a residual network followed by our proposed NetRVLAD, an encoding layer with reduced complexity compared to NetVLAD, is trained on 32x32 patches at keypoint locations. Additionally, we suggest a graph-based reranking algorithm called SGR to exploit similarities of the page embeddings to boost the retrieval performance. Our approach is evaluated on two historical datasets (Historical-WI and HisIR19). We include an evaluation of different backbones and NetRVLAD. It competes with related work on historical datasets without using explicit encodings. We set a new State-of-the-art on both datasets by applying our reranking scheme and show that our approach achieves comparable performance on a modern dataset as well.
Code (1)
Tasks
Graph SimilarityRerankingRetrievalWriter RetrievalSimilar Papers 제목 키워드 기반
Writer Retrieval and Writer Identification in Greek Papyri
The analysis of digitized historical manuscripts is typically addressed by paleographic experts. Writer identification refers to the classification of known writers while writer retrieval seeks to find the writer by mean…
BinarizationRetrievalWriter RetrievalBullingerDB: A Dataset for Handwritten Text Recognition and Writer Retrieval
We present BullingerDB, a large-scale benchmark dataset for historical document analysis based on the correspondence of Heinrich Bullinger (1504-1575). The corpus comprises 20,898 pages and 499,222 text lines written by …
Handwritten Text RecognitionSAGHOG: Self-Supervised Autoencoder for Generating HOG Features for Writer Retrieval
This paper introduces SAGHOG, a self-supervised pretraining strategy for writer retrieval using HOG features of the binarized input image. Our preprocessing involves the application of the Segment Anything technique to e…
RetrievalWriter RetrievalSelf-Supervised Vision Transformers for Writer Retrieval
While methods based on Vision Transformers (ViT) have achieved state-of-the-art performance in many domains, they have not yet been applied successfully in the domain of writer retrieval. The field is dominated by method…
RetrievalWriter RetrievalICDAR 2019 Competition on Image Retrieval for Historical Handwritten Documents
This competition investigates the performance of large-scale retrieval of historical document images based on writing style. Based on large image data sets provided by cultural heritage institutions and digital libraries…
Image RetrievalRetrievalWriter Retrieval