Correlation Verification for Image Retrieval
Geometric verification is considered a de facto solution for the re-ranking task in image retrieval. In this study, we propose a novel image retrieval re-ranking network named Correlation Verification Networks (CVNet). Our proposed network, comprising deeply stacked 4D convolutional layers, gradually compresses dense feature correlation into image similarity while learning diverse geometric matching patterns from various image pairs. To enable cross-scale matching, it builds feature pyramids and constructs cross-scale feature correlations within a single inference, replacing costly multi-scale inferences. In addition, we use curriculum learning with the hard negative mining and Hide-and-Seek strategy to handle hard samples without losing generality. Our proposed re-ranking network shows state-of-the-art performance on several retrieval benchmarks with a significant margin (+12.6% in mAP on ROxford-Hard+1M set) over state-of-the-art methods. The source code and models are available online: https://github.com/sungonce/CVNet.
Code (2)
Tasks
Feature CorrelationGeometric MatchingImage RetrievalRe-RankingRetrievalSimilar Papers 제목 키워드 기반
MEVER: Multi-Modal and Explainable Claim Verification with Graph-based Evidence Retrieval
Verifying the truthfulness of claims usually requires joint multi-modal reasoning over both textual and visual evidence, such as analyzing both textual caption and chart image for claim verification. In addition, to make…
Explanation GenerationSpecialized Re-Ranking: A Novel Retrieval-Verification Framework for Cloth Changing Person Re-Identification
Cloth changing person re-identification(Re-ID) can work under more complicated scenarios with higher security than normal Re-ID and biometric techniques and is therefore extremely valuable in applications. Meanwhile, hig…
Cloth-Changing Person Re-IdentificationPerson Re-IdentificationRe-RankingRetrievalR2Former: Unified Retrieval and Reranking Transformer for Place Recognition
Visual Place Recognition (VPR) estimates the location of query images by matching them with images in a reference database. Conventional methods generally adopt aggregated CNN features for global retrieval and RANSAC…
Feature CorrelationRerankingRetrievalVisual Place RecognitionRecognizing Families through Images with Pretrained Encoder
Kinship verification and kinship retrieval are emerging tasks in computer vision. Kinship verification aims at determining whether two facial images are from related people or not, while kinship retrieval is the task of …
Kinship VerificationRetrievalRe-identification = Retrieval + Verification: Back to Essence and Forward with a New Metric
Re-identification (re-ID) is currently investigated as a closed-world image retrieval task, and evaluated by retrieval based metrics. The algorithms return ranking lists to users, but cannot tell which images are the tru…
Image RetrievalRetrieval