Real-Time Monocular Object-Model Aware Sparse SLAM
Simultaneous Localization And Mapping (SLAM) is a fundamental problem in mobile robotics. While sparse point-based SLAM methods provide accurate camera localization, the generated maps lack semantic information. On the other hand, state of the art object detection methods provide rich information about entities present in the scene from a single image. This work incorporates a real-time deep-learned object detector to the monocular SLAM framework for representing generic objects as quadrics that permit detections to be seamlessly integrated while allowing the real-time performance. Finer reconstruction of an object, learned by a CNN network, is also incorporated and provides a shape prior for the quadric leading further refinement. To capture the dominant structure of the scene, additional planar landmarks are detected by a CNN-based plane detector and modeled as independent landmarks in the map. Extensive experiments support our proposed inclusion of semantic objects and planar structures directly in the bundle-adjustment of SLAM - Semantic SLAM - that enriches the reconstructed map semantically, while significantly improving the camera localization. The performance of our SLAM system is demonstrated in https://youtu.be/UMWXd4sHONw and https://youtu.be/QPQqVrvP0dE .
Code (0)
등록된 구현이 없습니다.
Tasks
Camera LocalizationmodelObjectobject-detectionObject DetectionSemantic SLAMSimultaneous Localization and MappingSimilar Papers 제목 키워드 기반
MonoSAOD: Monocular 3D Object Detection with Sparsely Annotated Label
Monocular 3D object detection has achieved impressive performance on densely annotated datasets. However, it struggles when only a fraction of objects are labeled due to the high cost of 3D annotation. This sparsely anno…
Monocular 3D Object DetectionDBMovi-GS: Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splatting
Novel view synthesis is a task of generating scenes from unseen perspectives; however, synthesizing dynamic scenes from blurry monocular videos remains an unresolved challenge that has yet to be effectively addressed. Ex…
3D geometryNovel View SynthesisAdvancing Self-supervised Monocular Depth Learning with Sparse LiDAR
Self-supervised monocular depth prediction provides a cost-effective solution to obtain the 3D location of each pixel. However, the existing approaches usually lead to unsatisfactory accuracy, which is critical for auton…
3D Object DetectionDepth CompletionDepth EstimationDepth Prediction+4MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer
Monocular 3D object detection is an important yet challenging task in autonomous driving. Some existing methods leverage depth information from an off-the-shelf depth estimator to assist 3D detection, but suffer from the…
3D Object Detection3D Object Detection From Monocular ImagesAutonomous DrivingMonocular 3D Object Detection+3Depth-Aware Rover: A Study of Edge AI and Monocular Vision for Real-World Implementation
This study analyses simulated and real-world implementations of depth-aware rover navigation, highlighting the transition from stereo vision to monocular depth estimation using edge AI. A Unity-based lunar terrain simula…
Monocular Depth EstimationReal-Time Object Detection