Unsupervised Video Depth Estimation Based on Ego-motion and Disparity Consensus
Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised monocular video depth estimation method in natural scenes by taking advantage of the state-of-the-art method of Zhou et al. which jointly estimates depth and camera motion. Our method advances beyond the baseline method by three aspects: 1) we add an additional signal as supervision to the baseline method by incorporating left-right binocular images reconstruction loss based on the estimated disparities, thus the left frame can be reconstructed by the temporal frames and right frames of stereo vision; 2) the network is trained by jointly using two kinds of view syntheses loss and left-right disparity consistency regularization to estimate depth and pose simultaneously; 3) we use the edge aware smooth L2 regularization to smooth the depth map while preserving the contour of the target. Extensive experiments on the KITTI autonomous driving dataset and Make3D dataset indicate the superiority of our algorithm in training efficiency. We can achieve competitive results with the baseline by only 3/5 times training data. The experimental results also show that our method even outperforms the classical supervised methods that using either ground truth depth or given pose for training.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDepth And Camera MotionDepth EstimationL2 RegularizationSimilar Papers 제목 키워드 기반
Unsupervised learning of depth and motion
We present a model for the joint estimation of disparity and motion. The model is based on learning about the interrelations between images from multiple cameras, multiple frames in a video, or the combination of both. W…
Unsupervised Monocular Depth Prediction for Indoor Continuous Video Streams
This paper studies unsupervised monocular depth prediction problem. Most of existing unsupervised depth prediction algorithms are developed for outdoor scenarios, while the depth prediction work in the indoor environment…
Depth EstimationDepth PredictionEnsemble LearningPose Estimation+1Dual CNN Models for Unsupervised Monocular Depth Estimation
The unsupervised depth estimation is the recent trend by utilizing the binocular stereo images to get rid of depth map ground truth. In unsupervised depth computation, the disparity images are generated by training the C…
Depth EstimationImage ReconstructionMonocular Depth EstimationUnsupervised Monocular Depth EstimationIntegrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matching
Unsupervised stereo matching has garnered significant attention for its independence from costly disparity annotations. Typical unsupervised methods rely on the multi-view consistency assumption for training networks, wh…
Depth estimation from 4D light field videos
Depth (disparity) estimation from 4D Light Field (LF) images has been a research topic for the last couple of years. Most studies have focused on depth estimation from static 4D LF images while not considering temporal i…
Depth EstimationDisparity Estimation