RenderNet: Visual Relocalization Using Virtual Viewpoints in Large-Scale Indoor Environments
Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor environments enables attractive applications such as augmented reality and robot navigation. However, appearance changes fast in such environments when the camera moves, which is challenging for the relocalization system. To address this problem, we propose a virtual view synthesis-based approach, RenderNet, to enrich the database and refine poses regarding this particular scenario. Instead of rendering real images which requires high-quality 3D models, we opt to directly render the needed global and local features of virtual viewpoints and apply them in the subsequent image retrieval and feature matching operations respectively. The proposed method can largely improve the performance in large-scale indoor environments, e.g., achieving an improvement of 7.1\% and 12.2\% on the Inloc dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalRetrievalRobot NavigationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic Object-level Modeling for Robust Visual Camera Relocalization
Visual relocalization is crucial for autonomous visual localization and navigation of mobile robotics. Due to the improvement of CNN-based object detection algorithm, the robustness of visual relocalization is greatly en…
Camera RelocalizationObjectobject-detectionObject Detection+1Hierarchical Visual Relocalization with Nearest View Synthesis from Feature Gaussian Splatting
Visual relocalization is a fundamental task in the field of 3D computer vision, estimating a camera's pose when it revisits a previously known scene. While point-based hierarchical relocalization methods have shown stron…
Pose EstimationVRS-NeRF: Visual Relocalization with Sparse Neural Radiance Field
Visual relocalization is a key technique to autonomous driving, robotics, and virtual/augmented reality. After decades of explorations, absolute pose regression (APR), scene coordinate regression (SCR), and hierarchical …
Autonomous DrivingNeRFregressionMap-free Visual Relocalization: Metric Pose Relative to a Single Image
Can we relocalize in a scene represented by a single reference image? Standard visual relocalization requires hundreds of images and scale calibration to build a scene-specific 3D map. In contrast, we propose Map-free Re…
Depth EstimationDepth PredictionRover Relocalization for Mars Sample Return by Virtual Template Synthesis and Matching
We consider the problem of rover relocalization in the context of the notional Mars Sample Return campaign. In this campaign, a rover (R1) needs to be capable of autonomously navigating and localizing itself within an ar…
Retrieval