CamNet: Coarse-to-Fine Retrieval for Camera Re-Localization
Camera re-localization is an important but challenging task in applications like robotics and autonomous driving. Recently, retrieval-based methods have been considered as a promising direction as they can be easily generalized to novel scenes. Despite significant progress has been made, we observe that the performance bottleneck of previous methods actually lies in the retrieval module. These methods use the same features for both retrieval and relative pose regression tasks which have potential conflicts in learning. To this end, here we present a coarse-to-fine retrieval-based deep learning framework, which includes three steps, i.e., image-based coarse retrieval, pose-based fine retrieval and precise relative pose regression. With our carefully designed retrieval module, the relative pose regression task can be surprisingly simpler. We design novel retrieval losses with batch hard sampling criterion and two-stage retrieval to locate samples that adapt to the relative pose regression task. Extensive experiments show that our model (CamNet) outperforms the state-of-the-art methods by a large margin on both indoor and outdoor datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingregressionRetrievalSimilar Papers 제목 키워드 기반
Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching
We address the problem of ground-to-satellite image geo-localization, that is, estimating the camera latitude, longitude and orientation (azimuth angle) by matching a query image captured at the ground level against a la…
geo-localizationImage RetrievalRetrievalGS-CPE: Unified 6-Degree-of-Freedom Camera Pose Estimation via 3D Gaussian Splatting
Despite substantial progress in visual localization, from scene coordinate regression to direct camera pose regression, achieving both robust generalization and high accuracy remain challenging. This study introduces GS-…
Camera Pose EstimationVisual LocalizationFrom Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splatting
This paper presents a novel camera relocalization method, STDLoc, which leverages Feature Gaussian as scene representation. STDLoc is a full relocalization pipeline that can achieve accurate relocalization without relyin…
Camera RelocalizationImage RetrievalPose EstimationAn End-to-End Real-World Camera Imaging Pipeline
Recent advances in neural camera imaging pipelines have demonstrated notable progress. Nevertheless, the real-world imaging pipeline still faces challenges including the lack of joint optimization in system components, c…
Image CompressionTone MappingCoarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenes
Robust and accurate localization is an essential component for robotic navigation and autonomous driving. The use of cameras for localization with high definition map (HD Map) provides an affordable localization sensor s…
Autonomous DrivingPose EstimationSemantic Segmentation