Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving
Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the scale ambiguity issue. In this paper, we introduce a fully Visual Attention-based Depth (VADepth) network, where spatial attention and channel attention are applied to all stages. By continuously extracting the dependencies of features along the spatial and channel dimensions over a long distance, VADepth network can effectively preserve important details and suppress interfering features to better perceive the scene structure for more accurate depth estimates. In addition, we utilize geometric priors to form scale constraints for scale-aware model training. Specifically, we construct a novel scale-aware loss using the distance between the camera and a plane fitted by the ground points corresponding to the pixels of the rectangular area in the bottom middle of the image. Experimental results on the KITTI dataset show that this architecture achieves the state-of-the-art performance and our method can directly output absolute depth without post-processing. Moreover, our experiments on the SeasonDepth dataset also demonstrate the robustness of our model to multiple unseen environments.
Code (2)
Tasks
Autonomous DrivingDepth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
EGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimation
The ubiquitous multi-camera setup on modern autonomous vehicles provides an opportunity to construct surround-view depth. Existing methods, however, either perform independent monocular depth estimations on each camera o…
Autonomous DrivingAutonomous VehiclesDepth EstimationDetaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation
Monocular depth estimation (MDE) in the self-supervised scenario has emerged as a promising method as it refrains from the requirement of ground truth depth. Despite continuous efforts, MDE is still sensitive to scale ch…
Data AugmentationDepth EstimationMonocular Depth EstimationSelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery
Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised…
Autonomous DrivingSelf-LearningSelf-Supervised LearningPromptMono: Cross Prompting Attention for Self-Supervised Monocular Depth Estimation in Challenging Environments
Considerable efforts have been made to improve monocular depth estimation under ideal conditions. However, in challenging environments, monocular depth estimation still faces difficulties. In this paper, we introduce vis…
Depth EstimationMonocular Depth EstimationPrompt LearningSelf-Supervised LearningTowards Scale-Aware, Robust, and Generalizable Unsupervised Monocular Depth Estimation by Integrating IMU Motion Dynamics
Unsupervised monocular depth and ego-motion estimation has drawn extensive research attention in recent years. Although current methods have reached a high up-to-scale accuracy, they usually fail to learn the true scale …
Depth EstimationMonocular Depth EstimationMotion EstimationUnsupervised Monocular Depth Estimation