6D Camera Relocalization in Visually Ambiguous Extreme Environments
We propose a novel method to reliably estimate the pose of a camera given a sequence of images acquired in extreme environments such as deep seas or extraterrestrial terrains. Data acquired under these challenging conditions are corrupted by textureless surfaces, image degradation, and presence of repetitive and highly ambiguous structures. When naively deployed, the state-of-the-art methods can fail in those scenarios as confirmed by our empirical analysis. In this paper, we attempt to make camera relocalization work in these extreme situations. To this end, we propose: (i) a hierarchical localization system, where we leverage temporal information and (ii) a novel environment-aware image enhancement method to boost the robustness and accuracy. Our extensive experimental results demonstrate superior performance in favor of our method under two extreme settings: localizing an autonomous underwater vehicle and localizing a planetary rover in a Mars-like desert. In addition, our method achieves comparable performance with state-of-the-art methods on the indoor benchmark (7-Scenes dataset) using only 20% training data.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera RelocalizationImage EnhancementSimilar Papers 제목 키워드 기반
6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference
We present a multimodal camera relocalization framework that captures ambiguities and uncertainties with continuous mixture models defined on the manifold of camera poses. In highly ambiguous environments, which can easi…
Camera LocalizationCamera RelocalizationLearning to Navigate the Energy Landscape
In this paper, we present a novel and efficient architecture for addressing computer vision problems that use `Analysis by Synthesis'. Analysis by synthesis involves the minimization of the reconstruction error which is …
Camera RelocalizationHand Pose EstimationImage RetrievalNavigate+2S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization
Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN)…
Camera RelocalizationSimultaneous Localization and MappingMVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalization
Camera relocalization, a cornerstone capability of modern computer vision, accurately determines a camera's position and orientation (6-DoF) from images and is essential for applications in augmented reality (AR), mixed …
Autonomous DrivingRenderNet: Visual Relocalization Using Virtual Viewpoints in Large-Scale Indoor Environments
Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor envir…
Image RetrievalRetrievalRobot Navigation