Fast Depth Estimation for View Synthesis
Disparity/depth estimation from sequences of stereo images is an important element in 3D vision. Owing to occlusions, imperfect settings and homogeneous luminance, accurate estimate of depth remains a challenging problem. Targetting view synthesis, we propose a novel learning-based framework making use of dilated convolution, densely connected convolutional modules, compact decoder and skip connections. The network is shallow but dense, so it is fast and accurate. Two additional contributions - a non-linear adjustment of the depth resolution and the introduction of a projection loss, lead to reduction of estimation error by up to 20% and 25% respectively. The results show that our network outperforms state-of-the-art methods with an average improvement in accuracy of depth estimation and view synthesis by approximately 45% and 34% respectively. Where our method generates comparable quality of estimated depth, it performs 10 times faster than those methods.
Code (1)
Tasks
DecoderDepth EstimationSimilar Papers 제목 키워드 기반
MSI-NeRF: Linking Omni-Depth with View Synthesis through Multi-Sphere Image aided Generalizable Neural Radiance Field
Panoramic observation using fisheye cameras is significant in virtual reality (VR) and robot perception. However, panoramic images synthesized by traditional methods lack depth information and can only provide three degr…
Depth EstimationNeRFNovel View SynthesisFaDIV-Syn: Fast Depth-Independent View Synthesis using Soft Masks and Implicit Blending
Novel view synthesis is required in many robotic applications, such as VR teleoperation and scene reconstruction. Existing methods are often too slow for these contexts, cannot handle dynamic scenes, and are limited by t…
Depth EstimationNovel View SynthesisProbNVS: Fast Novel View Synthesis with Learned Probability-Guided Sampling
Existing state-of-the-art novel view synthesis methods rely on either fairly accurate 3D geometry estimation or sampling of the entire space for neural volumetric rendering, which limit the overall efficiency. In order t…
3D geometryNovel View SynthesisNovel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera
This paper presents a new method to synthesize an image from arbitrary views and times given a collection of images of a dynamic scene. A key challenge for the novel view synthesis arises from dynamic scene reconstructio…
Depth EstimationNovel View SynthesisNVS-MonoDepth: Improving Monocular Depth Prediction with Novel View Synthesis
Building upon the recent progress in novel view synthesis, we propose its application to improve monocular depth estimation. In particular, we propose a novel training method split in three main steps. First, the predict…
Depth EstimationDepth PredictionImage GenerationMonocular Depth Estimation+1