Learning Depth from Monocular Videos using Direct Methods
The ability to predict depth from a single image - using recent advances in CNNs - is of increasing interest to the vision community. Unsupervised strategies to learning are particularly appealing as they can utilize much larger and varied monocular video datasets during learning without the need for ground truth depth or stereo. In previous works, separate pose and depth CNN predictors had to be determined such that their joint outputs minimized the photometric error. Inspired by recent advances in direct visual odometry (DVO), we argue that the depth CNN predictor can be learned without a pose CNN predictor. Further, we demonstrate empirically that incorporation of a differentiable implementation of DVO, along with a novel depth normalization strategy - substantially improves performance over state of the art that use monocular videos for training.
Code (1)
Tasks
Depth And Camera MotionVisual OdometrySimilar Papers 제목 키워드 기반
Spatial Correspondence With Generative Adversarial Network: Learning Depth From Monocular Videos
Depth estimation from monocular videos has important applications in many areas such as autonomous driving and robot navigation. It is a very challenging problem without knowing the camera pose since errors in camera-pos…
Autonomous DrivingCamera Pose EstimationDepth EstimationGenerative Adversarial Network+2Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos
While learning based depth estimation from images/videos has achieved substantial progress, there still exist intrinsic limitations. Supervised methods are limited by a small amount of ground truth or labeled data and un…
Depth EstimationDepth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras
We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly…
Depth EstimationDepth PredictionMonocular Depth EstimationUnsupervised Monocular Depth EstimationD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…
Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual OdometryPose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors
Omnidirectional 3D Gaussian Splatting with panoramas is a key technique for 3D scene representation, and existing methods typically rely on slow SfM to provide camera poses and sparse points priors. In this work, we prop…
Camera Pose EstimationNovel View Synthesis