Robust and Decomposable Average Precision for Image Retrieval
In image retrieval, standard evaluation metrics rely on score ranking, e.g. average precision (AP). In this paper, we introduce a method for robust and decomposable average precision (ROADMAP) addressing two major challenges for end-to-end training of deep neural networks with AP: non-differentiability and non-decomposability. Firstly, we propose a new differentiable approximation of the rank function, which provides an upper bound of the AP loss and ensures robust training. Secondly, we design a simple yet effective loss function to reduce the decomposability gap between the AP in the whole training set and its averaged batch approximation, for which we provide theoretical guarantees. Extensive experiments conducted on three image retrieval datasets show that ROADMAP outperforms several recent AP approximation methods and highlight the importance of our two contributions. Finally, using ROADMAP for training deep models yields very good performances, outperforming state-of-the-art results on the three datasets.
Code (1)
Tasks
Image RetrievalMetric LearningRetrievalSimilar Papers 제목 키워드 기반
Optimization of Rank Losses for Image Retrieval
In image retrieval, standard evaluation metrics rely on score ranking, \eg average precision (AP), recall at k (R@k), normalized discounted cumulative gain (NDCG). In this work we introduce a general framework for robust…
Image RetrievalRetrievalOptimizing Rank-Based Metrics With Blackbox Differentiation
Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-diffe…
Image RetrievalObjectobject-detectionObject Detection+1Optimizing Rank-based Metrics with Blackbox Differentiation
Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-diffe…
Image Retrievalobject-detectionObject DetectionRetrievalEfficient Optimization for Rank-based Loss Functions
The accuracy of information retrieval systems is often measured using complex loss functions such as the average precision (AP) or the normalized discounted cumulative gain (NDCG). Given a set of positive and negative sa…
Information RetrievalRetrievalMean Local Group Average Precision (mLGAP): A New Performance Metric for Hashing-based Retrieval
The research on hashing techniques for visual data is gaining increased attention in recent years due to the need for compact representations supporting efficient search/retrieval in large-scale databases such as online …
Image RetrievalRetrieval