Writer Identification and Writer Retrieval Based on NetVLAD with Re-ranking
This paper addresses writer identification and writer retrieval which is considered as a challenging problem in the document analysis and recognition field. In this work, a novel pipeline is proposed for the problem at hand by employing a unified neural network architecture consisting of the ResNet-20 as a feature extractor and an integrated NetVLAD layer, inspired by the vector of locally aggregated descriptors (VLAD), in the head of the latter part. Having defined this architecture, the triplet semi-hard loss function is used to directly learn an embedding for individual input image patches. Subsequently, generalized max-pooling technique is employed for the aggregation of embedded descriptors of each handwritten image. Also, a novel re-ranking strategy is introduced for the task of identification and retrieval based on $k$-reciprocal nearest neighbors, and it is shown that the pipeline can benefit tremendously from this step. Experimental evaluation has been done on the three publicly available datasets: the ICDAR 2013, CVL, and KHATT datasets. Results indicate that while we perform comparably to the state-of-the-art on the KHATT, our writer identification and writer retrieval pipeline achieves superior performance on the ICDAR 2013 and CVL datasets in terms of mAP.
Code (0)
등록된 구현이 없습니다.
Tasks
Re-RankingRetrievalTripletWriter RetrievalSimilar Papers 제목 키워드 기반
Re-ranking for Writer Identification and Writer Retrieval
Automatic writer identification is a common problem in document analysis. State-of-the-art methods typically focus on the feature extraction step with traditional or deep-learning-based techniques. In retrieval problems,…
Re-RankingRetrievalWriter RetrievalTowards Writer Retrieval for Historical Datasets
This paper presents an unsupervised approach for writer retrieval based on clustering SIFT descriptors detected at keypoint locations resulting in pseudo-cluster labels. With those cluster labels, a residual network foll…
Graph SimilarityRerankingRetrievalWriter RetrievalWriter Retrieval and Writer Identification in Greek Papyri
The analysis of digitized historical manuscripts is typically addressed by paleographic experts. Writer identification refers to the classification of known writers while writer retrieval seeks to find the writer by mean…
BinarizationRetrievalWriter RetrievalCVL-DataBase: An Off-Line Database for Writer Retrieval, Writer Identification and Word Spotting
In this paper a public database for writer retrieval, writer identification and word spotting is presented. The CVL-Database consists of 7 different handwritten texts (1 German and 6 English Texts) and 311 different writ…
RetrievalWriter RetrievalKaiRacters: Character-level-based Writer Retrieval for Greek Papyri
This paper presents a character-based approach for enhancing writer retrieval performance in the context of Greek papyri. Our contribution lies in introducing character-level annotations for frequently used characters, i…
RetrievalWriter Retrieval