Veritatem Dies Aperit- Temporally Consistent Depth Prediction Enabled by a Multi-Task Geometric and Semantic Scene Understanding Approach
Robust geometric and semantic scene understanding is ever more important in many real-world applications such as autonomous driving and robotic navigation. In this paper, we propose a multi-task learning-based approach capable of jointly performing geometric and semantic scene understanding, namely depth prediction (monocular depth estimation and depth completion) and semantic scene segmentation. Within a single temporally constrained recurrent network, our approach uniquely takes advantage of a complex series of skip connections, adversarial training and the temporal constraint of sequential frame recurrence to produce consistent depth and semantic class labels simultaneously. Extensive experimental evaluation demonstrates the efficacy of our approach compared to other contemporary state-of-the-art techniques.
Code (1)
Tasks
Autonomous DrivingDepth CompletionDepth EstimationDepth PredictionMonocular Depth EstimationMulti-Task LearningScene SegmentationScene UnderstandingSimilar Papers 제목 키워드 기반
Veritatem Dies Aperit - Temporally Consistent Depth Prediction Enabled by a Multi-Task Geometric and Semantic Scene Understanding Approach
Robust geometric and semantic scene understanding is ever more important in many real-world applications such as autonomous driving and robotic navigation. In this paper, we propose a multi-task learning-based approach c…
Autonomous DrivingDepth CompletionDepth EstimationDepth Prediction+4Temporally Consistent Online Depth Estimation in Dynamic Scenes
Temporally consistent depth estimation is crucial for online applications such as augmented reality. While stereo depth estimation has received substantial attention as a promising way to generate 3D information, there i…
Depth EstimationStereo Depth EstimationTemporally Consistent Online Depth Estimation Using Point-Based Fusion
Depth estimation is an important step in many computer vision problems such as 3D reconstruction, novel view synthesis, and computational photography. Most existing work focuses on depth estimation from single frames. Wh…
3D ReconstructionDepth EstimationNovel View SynthesisConsistent Depth of Moving Objects in Video
We present a method to estimate depth of a dynamic scene, containing arbitrary moving objects, from an ordinary video captured with a moving camera. We seek a geometrically and temporally consistent solution to this unde…
Depth EstimationDepth PredictionPredictionRolling Shutter Correction+1EndoStreamDepth: Temporally Consistent Monocular Depth Estimation for Endoscopic Video Streams
This work presents EndoStreamDepth, a monocular depth estimation framework for endoscopic video streams. It provides accurate depth maps with sharp anatomical boundaries for each frame, temporally consistent predictions …
Monocular Depth Estimation