Semantic Object-level Modeling for Robust Visual Camera Relocalization
Visual relocalization is crucial for autonomous visual localization and navigation of mobile robotics. Due to the improvement of CNN-based object detection algorithm, the robustness of visual relocalization is greatly enhanced especially in viewpoints where classical methods fail. However, ellipsoids (quadrics) generated by axis-aligned object detection may limit the accuracy of the object-level representation and degenerate the performance of visual relocalization system. In this paper, we propose a novel method of automatic object-level voxel modeling for accurate ellipsoidal representations of objects. As for visual relocalization, we design a better pose optimization strategy for camera pose recovery, to fully utilize the projection characteristics of 2D fitted ellipses and the 3D accurate ellipsoids. All of these modules are entirely intergrated into visual SLAM system. Experimental results show that our semantic object-level mapping and object-based visual relocalization methods significantly enhance the performance of visual relocalization in terms of robustness to new viewpoints.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera RelocalizationObjectobject-detectionObject DetectionVisual LocalizationSimilar Papers 제목 키워드 기반
Visual-Inertial Multi-Instance Dynamic SLAM with Object-level Relocalisation
In this paper, we present a tightly-coupled visual-inertial object-level multi-instance dynamic SLAM system. Even in extremely dynamic scenes, it can robustly optimise for the camera pose, velocity, IMU biases and build …
3D ReconstructionObjectObject TrackingMCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM System
Object-level SLAM offers structured and semantically meaningful environment representations, making it more interpretable and suitable for high-level robotic tasks. However, most existing approaches rely on RGB-D sensors…
ObjectObject SLAMOrcVIO: Object residual constrained Visual-Inertial Odometry
Introducing object-level semantic information into simultaneous localization and mapping (SLAM) system is critical. It not only improves the performance but also enables tasks specified in terms of meaningful objects. Th…
ObjectLoop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency
Visual simultaneous localization and mapping (SLAM) systems face challenges in detecting loop closure under the circumstance of large viewpoint changes. In this paper, we present an object-based loop closure detection me…
Graph MatchingLoop Closure DetectionObjectSimultaneous Localization and MappingGOReloc: Graph-based Object-Level Relocalization for Visual SLAM
This article introduces a novel method for object-level relocalization of robotic systems. It determines the pose of a camera sensor by robustly associating the object detections in the current frame with 3D objects in a…
Objectobject-detectionObject Detection