paper-with-me

홈 › Papers

6D Camera Relocalization in Visually Ambiguous Extreme Environments

2022-07-13 · Yang Zheng, Tolga Birdal, Fei Xia, Yanchao Yang, Yueqi Duan, Leonidas J. Guibas

We propose a novel method to reliably estimate the pose of a camera given a sequence of images acquired in extreme environments such as deep seas or extraterrestrial terrains. Data acquired under these challenging conditions are corrupted by textureless surfaces, image degradation, and presence of repetitive and highly ambiguous structures. When naively deployed, the state-of-the-art methods can fail in those scenarios as confirmed by our empirical analysis. In this paper, we attempt to make camera relocalization work in these extreme situations. To this end, we propose: (i) a hierarchical localization system, where we leverage temporal information and (ii) a novel environment-aware image enhancement method to boost the robustness and accuracy. Our extensive experimental results demonstrate superior performance in favor of our method under two extreme settings: localizing an autonomous underwater vehicle and localizing a planetary rover in a Mars-like desert. In addition, our method achieves comparable performance with state-of-the-art methods on the indoor benchmark (7-Scenes dataset) using only 20% training data.

📄 PDF Abstract BibTeX arXiv:2207.06333

Code (0)

등록된 구현이 없습니다.

Tasks

Camera RelocalizationImage Enhancement

Similar Papers 제목 키워드 기반

6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference

2020-04-09 · ECCV 2020 8 · Mai Bui, Tolga Birdal, Haowen Deng, Shadi Albarqouni 외

We present a multimodal camera relocalization framework that captures ambiguities and uncertainties with continuous mixture models defined on the manifold of camera poses. In highly ambiguous environments, which can easi…

Camera LocalizationCamera Relocalization

Learning to Navigate the Energy Landscape

2016-03-18 · Julien Valentin, Angela Dai, Matthias Nießner, Pushmeet Kohli 외

In this paper, we present a novel and efficient architecture for addressing computer vision problems that use `Analysis by Synthesis'. Analysis by synthesis involves the minimization of the reconstruction error which is …

Camera RelocalizationHand Pose EstimationImage RetrievalNavigate+2

S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization

2022-05-12 · Ran Cheng, Xinyu Jiang, Yuan Chen, Lige Liu 외

Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN)…

Camera RelocalizationSimultaneous Localization and Mapping

MVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalization

2025-07-06 · Zhendong Xiao, Wu Wei, Shujie Ji, Shan Yang 외 arxiv

Camera relocalization, a cornerstone capability of modern computer vision, accurately determines a camera's position and orientation (6-DoF) from images and is essential for applications in augmented reality (AR), mixed …

Autonomous Driving

RenderNet: Visual Relocalization Using Virtual Viewpoints in Large-Scale Indoor Environments

2022-07-26 · Jiahui Zhang, Shitao Tang, Kejie Qiu, Rui Huang 외

Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor envir…

Image RetrievalRetrievalRobot Navigation