Learning Multi-View Camera Relocalization With Graph Neural Networks
We propose to construct a view graph to excavate the information of the whole given sequence for absolute camera pose estimation. Specifically, we harness GNNs to model the graph, allowing even non-consecutive frames to exchange information with each other. Rather than adopting the regular GNNs directly, we redefine the nodes, edges, and embedded functions to fit the relocalization task. Redesigned GNNs cooperate with CNNs in guiding knowledge propagation and feature extraction respectively to process multi-view high-dimension image features iteratively at different levels. Besides, a general graph-based loss function beyond constraints between consecutive views is employed for training the network in an end-to-end fashion. Extensive experiments conducted on both indoor and outdoor datasets demonstrate that our method outperforms previous approaches especially in large-scale and challenging scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera LocalizationCamera Pose EstimationCamera RelocalizationPose EstimationVisual LocalizationSimilar Papers 제목 키워드 기반
S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization
Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN)…
Camera RelocalizationSimultaneous Localization and MappingGeoFlow-SLAM++: A Robust Multi-Camera Visual-Inertial SLAM System with Relocalization
Monocular and RGB-D visual-inertial SLAM systems remain susceptible to limited field of view, sensor-specific failure modes, and unreliable cross-session relocalization. To address these issues, we present GeoFlow-SLAM++…
WSCLoc: Weakly-Supervised Sparse-View Camera Relocalization
Despite the advancements in deep learning for camera relocalization tasks, obtaining ground truth pose labels required for the training process remains a costly endeavor. While current weakly supervised methods excel in …
Camera RelocalizationImage ReconstructionNeRFPose EstimationSemantic Object-level Modeling for Robust Visual Camera Relocalization
Visual relocalization is crucial for autonomous visual localization and navigation of mobile robotics. Due to the improvement of CNN-based object detection algorithm, the robustness of visual relocalization is greatly en…
Camera RelocalizationObjectobject-detectionObject Detection+1KFNet: Learning Temporal Camera Relocalization using Kalman Filtering
Temporal camera relocalization estimates the pose with respect to each video frame in sequence, as opposed to one-shot relocalization which focuses on a still image. Even though the time dependency has been taken into ac…
Camera Relocalization