Graph-CoVis: GNN-based Multi-view Panorama Global Pose Estimation
In this paper, we address the problem of wide-baseline camera pose estimation from a group of 360$^\circ$ panoramas under upright-camera assumption. Recent work has demonstrated the merit of deep-learning for end-to-end direct relative pose regression in 360$^\circ$ panorama pairs [11]. To exploit the benefits of multi-view logic in a learning-based framework, we introduce Graph-CoVis, which non-trivially extends CoVisPose [11] from relative two-view to global multi-view spherical camera pose estimation. Graph-CoVis is a novel Graph Neural Network based architecture that jointly learns the co-visible structure and global motion in an end-to-end and fully-supervised approach. Using the ZInD [4] dataset, which features real homes presenting wide-baselines, occlusion, and limited visual overlap, we show that our model performs competitively to state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationGraph Neural NetworkPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Network
Reconstructing 3D layouts from multiple $360^{\circ}$ panoramas has received increasing attention recently as estimating a complete layout of a large-scale and complex room from a single panorama is very difficult. The s…
GPRCoVisPose: Co-Visibility Pose Transformer for Wide-Baseline Relative Pose Estimation in 360◦ Indoor Panoramas
We present CoVisPose, a new end-to-end supervised learning method for relative camera pose estimation in wide baseline 360 indoor panoramas. To address the challenges of occlusion, perspective changes, and textureless …
Camera Pose EstimationDecoderPose EstimationregressionCross-view image geo-localization with Panorama-BEV Co-Retrieval Network
Cross-view geolocalization identifies the geographic location of street view images by matching them with a georeferenced satellite database. Significant challenges arise due to the drastic appearance and geometry differ…
geo-localizationImage RetrievalRetrievalCoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesis
We propose Covisibility Map-based Gaussian Splatting (CoMapGS), designed to recover underrepresented sparse regions in sparse novel view synthesis. CoMapGS addresses both high- and low-uncertainty regions by constructing…
3DGSNeRFNovel View SynthesisLearning Cross-view Correspondences for Geo-localization on Planetary Surfaces
Maintaining global position awareness is a fundamental challenge for planetary surface exploration, since satellite-based positioning systems are unavailable and onboard odometry drifts over time. Although orbital mappin…