Depth Estimation from Monocular Images and Sparse radar using Deep Ordinal Regression Network
We integrate sparse radar data into a monocular depth estimation model and introduce a novel preprocessing method for reducing the sparseness and limited field of view provided by radar. We explore the intrinsic error of different radar modalities and show our proposed method results in more data points with reduced error. We further propose a novel method for estimating dense depth maps from monocular 2D images and sparse radar measurements using deep learning based on the deep ordinal regression network by Fu et al. Radar data are integrated by first converting the sparse 2D points to a height-extended 3D measurement and then including it into the network using a late fusion approach. Experiments are conducted on the nuScenes dataset. Our experiments demonstrate state-of-the-art performance in both day and night scenes.
Code (1)
Tasks
Depth EstimationMonocular Depth EstimationregressionSimilar Papers 제목 키워드 기반
RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale
We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings,…
Depth EstimationDepth PredictionHow Much Depth Information can Radar Contribute to a Depth Estimation Model?
Recently, several works have proposed fusing radar data as an additional perceptual signal into monocular depth estimation models because radar data is robust against varying light and weather conditions. Although improv…
Autonomous DrivingDepth EstimationMonocular Depth EstimationDepth Estimation from Monocular Images and Sparse Radar Data
In this paper, we explore the possibility of achieving a more accurate depth estimation by fusing monocular images and Radar points using a deep neural network. We give a comprehensive study of the fusion between RGB ima…
Depth EstimationRaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation
Dense metric depth estimation using millimeter-wave radar typically requires dense LiDAR supervision, generated via multi-frame projection and interpolation, to guide the learning of accurate depth from sparse radar meas…
Depth EstimationDepth PredictionSelf-Attention Dense Depth Estimation Network for Unrectified Video Sequences
The dense depth estimation of a 3D scene has numerous applications, mainly in robotics and surveillance. LiDAR and radar sensors are the hardware solution for real-time depth estimation, but these sensors produce sparse …
Depth Estimation