Unsupervised Monocular Depth Estimation in Highly Complex Environments
With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some challenging environments, like night and rainy night, the essential photometric consistency hypothesis is untenable because of the complex lighting and reflection, so that the above unsupervised framework cannot be directly applied to these complex scenarios. In this paper, we investigate the problem of unsupervised monocular depth estimation in highly complex scenarios and address this challenging problem by adopting an image transfer-based domain adaptation framework. We adapt the depth model trained on day-time scenarios to be applicable to night-time scenarios, and constraints on both feature space and output space promote the framework to learn the key features for depth decoding. Meanwhile, we further tackle the effects of unstable image transfer quality on domain adaptation, and an image adaptation approach is proposed to evaluate the quality of transferred images and re-weight the corresponding losses, so as to improve the performance of the adapted depth model. Extensive experiments show the effectiveness of the proposed unsupervised framework in estimating the dense depth map from highly complex images.
Code (1)
Tasks
Depth EstimationDomain AdaptationMonocular Depth EstimationPose EstimationUnsupervised Monocular Depth EstimationSimilar Papers 제목 키워드 기반
Unsupervised Monocular Depth Reconstruction of Non-Rigid Scenes
Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists li…
Depth EstimationMotion SegmentationUnsupervised monocular stereo matching
At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based …
Depth EstimationMonocular Depth EstimationStereo MatchingStereo Matching HandPseudo Supervised Monocular Depth Estimation with Teacher-Student Network
Despite recent improvement of supervised monocular depth estimation, the lack of high quality pixel-wise ground truth annotations has become a major hurdle for further progress. In this work, we propose a new unsupervise…
Depth EstimationKnowledge DistillationMonocular Depth EstimationUnsupervised Monocular Depth EstimationMiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation
Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effectiv…
CPUDepth EstimationDepth PredictionGPU+4Back to the Color: Learning Depth to Specific Color Transformation for Unsupervised Depth Estimation
Virtual engines can generate dense depth maps for various synthetic scenes, making them invaluable for training depth estimation models. However, discrepancies between synthetic and real-world colors pose significant cha…
Depth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation