Robust Scale Estimation in Real-Time Monocular SFM for Autonomous Driving
Scale drift is a crucial challenge for monocular autonomous driving to emulate the performance of stereo. This paper presents a real-time monocular SFM system that corrects for scale drift using a novel cue combination framework for ground plane estimation, yielding accuracy comparable to stereo over long driving sequences. Our ground plane estimation uses multiple cues like sparse features, dense inter-frame stereo and (when applicable) object detection. A data-driven mechanism is proposed to learn models from training data that relate observation covariances for each cue to error behavior of its underlying variables. During testing, this allows per-frame adaptation of observation covariances based on relative confidences inferred from visual data. Our framework significantly boosts not only the accuracy of monocular self-localization, but also that of applications like object localization that rely on the ground plane. Experiments on the KITTI dataset demonstrate the accuracy of our ground plane estimation, monocular SFM and object localization relative to ground truth, with detailed comparisons to prior art.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingObjectobject-detectionObject DetectionObject LocalizationSimilar Papers 제목 키워드 기반
Dense Prediction Transformer for Scale Estimation in Monocular Visual Odometry
Monocular visual odometry consists of the estimation of the position of an agent through images of a single camera, and it is applied in autonomous vehicles, medical robots, and augmented reality. However, monocular syst…
Autonomous VehiclesMonocular Visual OdometryPositionVisual OdometryRTS-Mono: A Real-Time Self-Supervised Monocular Depth Estimation Method for Real-World Deployment
Depth information is crucial for autonomous driving and intelligent robot navigation. The simplicity and flexibility of self-supervised monocular depth estimation are conducive to its role in these fields. However, most …
Monocular Depth EstimationAutonomous DrivingRobot NavigationMonocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervision
Depth information is essential for on-board perception in autonomous driving and driver assistance. Monocular depth estimation (MDE) is very appealing since it allows for appearance and depth being on direct pixelwise co…
Autonomous DrivingDepth EstimationMonocular Depth EstimationMGNiceNet: Unified Monocular Geometric Scene Understanding
Monocular geometric scene understanding combines panoptic segmentation and self-supervised depth estimation, focusing on real-time application in autonomous vehicles. We introduce MGNiceNet, a unified approach that uses …
Autonomous DrivingAutonomous VehiclesDepth EstimationDepth Prediction+5Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving
Amidst the rapid advancement of camera-based autonomous driving technology, effectiveness is often prioritized with limited attention to computational efficiency. To address this issue, this paper introduces LRHPerceptio…
Computational EfficiencyTrajectory PredictionAutonomous DrivingRoad Segmentation