SuperGF: Unifying Local and Global Features for Visual Localization
Advanced visual localization techniques encompass image retrieval challenges and 6 Degree-of-Freedom (DoF) camera pose estimation, such as hierarchical localization. Thus, they must extract global and local features from input images. Previous methods have achieved this through resource-intensive or accuracy-reducing means, such as combinatorial pipelines or multi-task distillation. In this study, we present a novel method called SuperGF, which effectively unifies local and global features for visual localization, leading to a higher trade-off between localization accuracy and computational efficiency. Specifically, SuperGF is a transformer-based aggregation model that operates directly on image-matching-specific local features and generates global features for retrieval. We conduct experimental evaluations of our method in terms of both accuracy and efficiency, demonstrating its advantages over other methods. We also provide implementations of SuperGF using various types of local features, including dense and sparse learning-based or hand-crafted descriptors.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationComputational EfficiencyImage RetrievalPose EstimationRetrievalSparse LearningVisual LocalizationSimilar Papers 제목 키워드 기반
Unifying Local and Global Multimodal Features for Place Recognition in Aliased and Low-Texture Environments
Perceptual aliasing and weak textures pose significant challenges to the task of place recognition, hindering the performance of Simultaneous Localization and Mapping (SLAM) systems. This paper presents a novel model, ca…
Re-RankingSimultaneous Localization and MappingReuse your features: unifying retrieval and feature-metric alignment
We propose a compact pipeline to unify all the steps of Visual Localization: image retrieval, candidate re-ranking and initial pose estimation, and camera pose refinement. Our key assumption is that the deep features use…
Image RetrievalPose EstimationRe-RankingRetrieval+1Unifying Deep Local and Global Features for Image Search
Image retrieval is the problem of searching an image database for items that are similar to a query image. To address this task, two main types of image representations have been studied: global and local image features.…
Dimensionality ReductionImage RetrievalRetrievalX-volution: On the unification of convolution and self-attention
Convolution and self-attention are acting as two fundamental building blocks in deep neural networks, where the former extracts local image features in a linear way while the latter non-locally encodes high-order context…
Image ClassificationInstance SegmentationObject DetectionT1: Scaling Diffusion Probabilistic Fields to High-Resolution on Unified Visual Modalities
Diffusion Probabilistic Field (DPF) models the distribution of continuous functions defined over metric spaces. While DPF shows great potential for unifying data generation of various modalities including images, videos,…
3D geometry