Deep Planar Parallax for Monocular Depth Estimation
Recent research has highlighted the utility of Planar Parallax Geometry in monocular depth estimation. However, its potential has yet to be fully realized because networks rely heavily on appearance for depth prediction. Our in-depth analysis reveals that utilizing flow-pretrain can optimize the network's usage of consecutive frame modeling, leading to substantial performance enhancement. Additionally, we propose Planar Position Embedding (PPE) to handle dynamic objects that defy static scene assumptions and to tackle slope variations that are challenging to differentiate. Comprehensive experiments on autonomous driving datasets, namely KITTI and the Waymo Open Dataset (WOD), prove that our Planar Parallax Network (PPNet) significantly surpasses existing learning-based methods in performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDepth EstimationDepth PredictionMonocular Depth EstimationPositionSimilar Papers 제목 키워드 기반
DepthP+P: Metric Accurate Monocular Depth Estimation using Planar and Parallax
Current self-supervised monocular depth estimation methods are mostly based on estimating a rigid-body motion representing camera motion. These methods suffer from the well-known scale ambiguity problem in their predicti…
Depth EstimationMonocular Depth EstimationTranslationMonocular Road Planar Parallax Estimation
Estimating the 3D structure of the drivable surface and surrounding environment is a crucial task for assisted and autonomous driving. It is commonly solved either by using 3D sensors such as LiDAR or directly predicting…
3D ReconstructionAutonomous DrivingMonoPP: Metric-Scaled Self-Supervised Monocular Depth Estimation by Planar-Parallax Geometry in Automotive Applications
Self-supervised monocular depth estimation (MDE) has gained popularity for obtaining depth predictions directly from videos. However, these methods often produce scale invariant results, unless additional training signal…
Depth EstimationDepth PredictionMonocular Depth EstimationPositionJoint Prediction of Monocular Depth and Structure using Planar and Parallax Geometry
Supervised learning depth estimation methods can achieve good performance when trained on high-quality ground-truth, like LiDAR data. However, LiDAR can only generate sparse 3D maps which causes losing information. Obtai…
Depth EstimationDepth PredictionGamma-from-Mono: Road-Relative, Metric, Self-Supervised Monocular Geometry for Vehicular Applications
Accurate perception of the vehicle's 3D surroundings, including fine-scale road geometry, such as bumps, slopes, and surface irregularities, is essential for safe and comfortable vehicle control. However, conventional mo…
Monocular Depth EstimationSelf-Supervised LearningMotion Planning