Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Masks
A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of depth and ego-motion without truth values. The main contribution of our method is to carefully consider the occlusion of the pixels generated when the adjacent frames are projected to each other, and the blank problem generated in the projection target imaging plane. Two fine masks are designed to solve most of the image pixel mismatch caused by the movement of the camera. In addition, some relatively rare circumstances are considered, and repeated masking is proposed. To some extent, the method is to use a geometric relationship to filter the mismatched pixels for training, making unsupervised learning more efficient and accurate. The experiments on KITTI dataset show our method achieves good performance in terms of depth and ego-motion. The generalization capability of our method is demonstrated by training on the low-quality uncalibrated bike video dataset and evaluating on KITTI dataset, and the results are still good.
Code (1)
Tasks
Depth EstimationMotion EstimationSimilar Papers 제목 키워드 기반
Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraints
We present a novel approach for unsupervised learning of depth and ego-motion from monocular video. Unsupervised learning removes the need for separate supervisory signals (depth or ego-motion ground truth, or multi-view…
3D geometryDepth And Camera MotionDepth EstimationMonocular Depth Estimation+1RM-Depth: Unsupervised Learning of Recurrent Monocular Depth in Dynamic Scenes
Unsupervised methods have showed promising results on monocular depth estimation. However, the training data must be captured in scenes without moving objects. To push the envelope of accuracy, recent methods tend to inc…
DecoderDepth EstimationMonocular Depth EstimationUnsupervised Monocular Depth EstimationDynamo-Depth: Fixing Unsupervised Depth Estimation for Dynamical Scenes
Unsupervised monocular depth estimation techniques have demonstrated encouraging results but typically assume that the scene is static. These techniques suffer when trained on dynamical scenes, where apparent object moti…
Depth EstimationMonocular Depth EstimationMotion SegmentationSegmentation+1Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semantics
We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D mo…
Depth And Camera MotionDepth EstimationMonocular Depth EstimationMotion EstimationFIS-Nets: Full-image Supervised Networks for Monocular Depth Estimation
This paper addresses the importance of full-image supervision for monocular depth estimation. We propose a semi-supervised architecture, which combines both unsupervised framework of using image consistency and supervise…
Depth CompletionDepth EstimationMonocular Depth Estimation