Global-to-Local or Local-to-Global? Enhancing Image Retrieval with Efficient Local Search and Effective Global Re-ranking
The dominant paradigm in image retrieval systems today is to search large databases using global image features, and re-rank those initial results with local image feature matching techniques. This design, dubbed global-to-local, stems from the computational cost of local matching approaches, which can only be afforded for a small number of retrieved images. However, emerging efficient local feature search approaches have opened up new possibilities, in particular enabling detailed retrieval at large scale, to find partial matches which are often missed by global feature search. In parallel, global feature-based re-ranking has shown promising results with high computational efficiency. In this work, we leverage these building blocks to introduce a local-to-global retrieval paradigm, where efficient local feature search meets effective global feature re-ranking. Critically, we propose a re-ranking method where global features are computed on-the-fly, based on the local feature retrieval similarities. Such re-ranking-only global features leverage multidimensional scaling techniques to create embeddings which respect the local similarities obtained during search, enabling a significant re-ranking boost. Experimentally, we demonstrate solid retrieval performance, setting new state-of-the-art results on the Revisited Oxford and Paris datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyImage RetrievalSimilar Papers 제목 키워드 기반
PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understanding
Some self-supervised cross-modal learning approaches have recently demonstrated the potential of image signals for enhancing point cloud representation. However, it remains a question on how to directly model cross-modal…
3D Object ClassificationRepresentation LearningEnhancing Outlier Knowledge for Few-Shot Out-of-Distribution Detection with Extensible Local Prompts
Out-of-Distribution (OOD) detection, aiming to distinguish outliers from known categories, has gained prominence in practical scenarios. Recently, the advent of vision-language models (VLM) has heightened interest in enh…
Out-of-Distribution DetectionOut of Distribution (OOD) DetectionSemantic-Guided Global-Local Collaborative Networks for Lightweight Image Super-Resolution
Single-Image Super-Resolution (SISR) plays a pivotal role in enhancing the accuracy and reliability of measurement systems, which are integral to various vision-based instrumentation and measurement applications. These s…
Image Super-ResolutionSSIMSuper-ResolutionGlobal and Local Semantic Completion Learning for Vision-Language Pre-training
Cross-modal alignment plays a crucial role in vision-language pre-training (VLP) models, enabling them to capture meaningful associations across different modalities. For this purpose, numerous masked modeling tasks have…
cross-modal alignmentImage-text RetrievalLanguage ModellingMasked Language Modeling+5LGFCTR: Local and Global Feature Convolutional Transformer for Image Matching
Image matching that finding robust and accurate correspondences across images is a challenging task under extreme conditions. Capturing local and global features simultaneously is an important way to mitigate such an iss…
Decoderregression