S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization
Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN), as an end-to-end framework for efficient and robust camera relocalization. S3E-GNN consists of two modules. In the encoding module, a trained S3E network encodes RGB images into embedding codes to implicitly represent spatial and semantic embedding code. With embedding codes and the associated poses obtained from a SLAM system, each image is represented as a graph node in a pose graph. In the GNN query module, the pose graph is transformed to form a embedding-aggregated reference graph for camera relocalization. We collect various scene datasets in the challenging environments to perform experiments. Our results demonstrate that S3E-GNN method outperforms the traditional Bag-of-words (BoW) for camera relocalization due to learning-based embedding and GNN powered scene matching mechanism.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera RelocalizationSimultaneous Localization and MappingSimilar Papers 제목 키워드 기반
Graph-Guided Scene Reconstruction from Images with 3D Gaussian Splatting
This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for in…
3D Reconstruction3D Scene ReconstructionSparseCam4D: Spatio-Temporally Consistent 4D Reconstruction from Sparse Cameras
High-quality 4D reconstruction enables photorealistic and immersive rendering of the dynamic real world. However, unlike static scenes that can be fully captured with a single camera, high-quality dynamic scenes typicall…
Dynamic ReconstructionSpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations
Novel view synthesis (NVS) boosts immersive experiences in computer vision and graphics. Existing techniques, though progressed, rely on dense multi-view observations, restricting their application. This work takes on th…
Novel View SynthesisSpatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Tracking
Accurate online multiple-camera vehicle tracking is essential for intelligent transportation systems, autonomous driving, and smart city applications. Like single-camera multiple-object tracking, it is commonly formulate…
Autonomous DrivingMulti-Object TrackingMultiple Object TrackingObject TrackingGraph Attention Network for Camera Relocalization on Dynamic Scenes
We devise a graph attention network-based approach for learning a scene triangle mesh representation in order to estimate an image camera position in a dynamic environment. Previous approaches built a scene-dependent mod…
Camera RelocalizationGraph AttentionGraph Neural Network