FusionMapping: Learning Depth Prediction with Monocular Images and 2D Laser Scans
Acquiring accurate three-dimensional depth information conventionally requires expensive multibeam LiDAR devices. Recently, researchers have developed a less expensive option by predicting depth information from two-dimensional color imagery. However, there still exists a substantial gap in accuracy between depth information estimated from two-dimensional images and real LiDAR point-cloud. In this paper, we introduce a fusion-based depth prediction method, called FusionMapping. This is the first method that fuses colored imagery and two-dimensional laser scan to estimate depth in-formation. More specifically, we propose an autoencoder-based depth prediction network and a novel point-cloud refinement network for depth estimation. We analyze the performance of our FusionMapping approach on the KITTI LiDAR odometry dataset and an indoor mobile robot system. The results show that our introduced approach estimates depth with better accuracy when compared to existing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationDepth PredictionSimilar Papers 제목 키워드 기반
Parse Geometry from a Line: Monocular Depth Estimation with Partial Laser Observation
Many standard robotic platforms are equipped with at least a fixed 2D laser range finder and a monocular camera. Although those platforms do not have sensors for 3D depth sensing capability, knowledge of depth is an esse…
Depth CompletionDepth EstimationLASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction
Recent feed-forward reconstruction models like VGGT and $π^3$ achieve impressive reconstruction quality but cannot process streaming videos due to quadratic memory complexity, limiting their practical deployment. While e…
Camera Pose EstimationSelf-supervised 3D Object Detection from Monocular Pseudo-LiDAR
There have been attempts to detect 3D objects by fusion of stereo camera images and LiDAR sensor data or using LiDAR for pre-training and only monocular images for testing, but there have been less attempts to use only m…
3D Object DetectionDepth EstimationDepth PredictionObject+3Connecting the Dots: Learning Representations for Active Monocular Depth Estimation
We propose a technique for depth estimation with a monocular structured-light camera, i.e., a calibrated stereo set-up with one camera and one laser projector. Instead of formulating the depth estimation via a correspond…
Depth EstimationDepth PredictionMonocular Depth EstimationSelf-Supervised Monocular Depth Hints
Monocular depth estimators can be trained with various forms of self-supervision from binocular-stereo data to circumvent the need for high-quality laser scans or other ground-truth data. The disadvantage, however, is th…
Depth EstimationDepth PredictionMonocular Depth EstimationSelf-Supervised Learning