RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimation
Existing self-supervised monocular depth estimation methods can get rid of expensive annotations and achieve promising results. However, these methods suffer from severe performance degradation when directly adopting a model trained on a fixed resolution to evaluate at other different resolutions. In this paper, we propose a resolution adaptive self-supervised monocular depth estimation method (RA-Depth) by learning the scale invariance of the scene depth. Specifically, we propose a simple yet efficient data augmentation method to generate images with arbitrary scales for the same scene. Then, we develop a dual high-resolution network that uses the multi-path encoder and decoder with dense interactions to aggregate multi-scale features for accurate depth inference. Finally, to explicitly learn the scale invariance of the scene depth, we formulate a cross-scale depth consistency loss on depth predictions with different scales. Extensive experiments on the KITTI, Make3D and NYU-V2 datasets demonstrate that RA-Depth not only achieves state-of-the-art performance, but also exhibits a good ability of resolution adaptation.
Code (1)
Tasks
Data AugmentationDecoderDepth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
SaccadeCam: Adaptive Visual Attention for Monocular Depth Sensing
Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the sce…
Depth EstimationMonocular Depth EstimationSuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimation
Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-su…
Depth EstimationDepth PredictionImage Super-ResolutionMonocular Depth Estimation+2RTS-Mono: A Real-Time Self-Supervised Monocular Depth Estimation Method for Real-World Deployment
Depth information is crucial for autonomous driving and intelligent robot navigation. The simplicity and flexibility of self-supervised monocular depth estimation are conducive to its role in these fields. However, most …
Monocular Depth EstimationAutonomous DrivingRobot NavigationDeep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation
With the frequent use of self-supervised monocular depth estimation in robotics and autonomous driving, the model's efficiency is becoming increasingly important. Most current approaches apply much larger and more comple…
Autonomous DrivingDecoderDepth EstimationMonocular Depth EstimationMulti-resolution Monocular Depth Map Fusion by Self-supervised Gradient-based Composition
Monocular depth estimation is a challenging problem on which deep neural networks have demonstrated great potential. However, depth maps predicted by existing deep models usually lack fine-grained details due to the conv…
Depth EstimationMonocular Depth Estimation