Improving Worst Case Visual Localization Coverage via Place-specific Sub-selection in Multi-camera Systems
6-DoF visual localization systems utilize principled approaches rooted in 3D geometry to perform accurate camera pose estimation of images to a map. Current techniques use hierarchical pipelines and learned 2D feature extractors to improve scalability and increase performance. However, despite gains in typical recall@0.25m type metrics, these systems still have limited utility for real-world applications like autonomous vehicles because of their worst' areas of performance - the locations where they provide insufficient recall at a certain required error tolerance. Here we investigate the utility of using place specific configurations', where a map is segmented into a number of places, each with its own configuration for modulating the pose estimation step, in this case selecting a camera within a multi-camera system. On the Ford AV benchmark dataset, we demonstrate substantially improved worst-case localization performance compared to using off-the-shelf pipelines - minimizing the percentage of the dataset which has low recall at a certain error tolerance, as well as improved overall localization performance. Our proposed approach is particularly applicable to the crowdsharing model of autonomous vehicle deployment, where a fleet of AVs are regularly traversing a known route.
Code (0)
등록된 구현이 없습니다.
Tasks
3D geometryAutonomous VehiclesCamera Pose EstimationPose EstimationVisual LocalizationSimilar Papers 제목 키워드 기반
Localized Adaptive Risk Control
Adaptive Risk Control (ARC) is an online calibration strategy based on set prediction that offers worst-case deterministic long-term risk control, as well as statistical marginal coverage guarantees. ARC adjusts the size…
ARCFairnessImage SegmentationPrediction+1Aerial Intelligent Reflecting Surface: Joint Placement and Passive Beamforming Design with 3D Beam Flattening
This paper proposes a new three-dimensional (3D) wireless passive relaying system enabled by aerial IRS (AIRS). Compared to the conventional terrestrial IRS, AIRS enjoys more deployment flexibility as well as wider-range…
A Deep Learning Approach in RIS-based Indoor Localization
In the domain of RIS-based indoor localization, our work introduces two distinct approaches to address real-world challenges. The first method is based on deep learning, employing a Long Short-Term Memory (LSTM) network.…
Deep LearningIndoor LocalizationConservative neural posterior estimation via distributionally robust training
Simulation-based inference with neural posterior estimation (NPE) often yields overconfident and unreliable posteriors under limited simulation budgets. To address this, we propose DRO-NPE, a distributionally robust appr…
Rethinking Visual Geo-localization for Large-Scale Applications
Visual Geo-localization (VG) is the task of estimating the position where a given photo was taken by comparing it with a large database of images of known locations. To investigate how existing techniques would perform o…
Contrastive Learninggeo-localizationGPUImage Classification+2