MFuseNet: Robust Depth Estimation with Learned Multiscopic Fusion
We design a multiscopic vision system that utilizes a low-cost monocular RGB camera to acquire accurate depth estimation. Unlike multi-view stereo with images captured at unconstrained camera poses, the proposed system controls the motion of a camera to capture a sequence of images in horizontally or vertically aligned positions with the same parallax. In this system, we propose a new heuristic method and a robust learning-based method to fuse multiple cost volumes between the reference image and its surrounding images. To obtain training data, we build a synthetic dataset with multiscopic images. The experiments on the real-world Middlebury dataset and real robot demonstration show that our multiscopic vision system outperforms traditional two-frame stereo matching methods in depth estimation. Our code and dataset are available at https://sites.google.com/view/multiscopic.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationStereo MatchingSimilar Papers 제목 키워드 기반
Stereo Matching by Self-supervision of Multiscopic Vision
Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attra…
Depth EstimationSelf-Supervised LearningStereo MatchingActive Perception with A Monocular Camera for Multiscopic Vision
We design a multiscopic vision system that utilizes a low-cost monocular RGB camera to acquire accurate depth estimation for robotic applications. Unlike multi-view stereo with images captured at unconstrained camera pos…
Depth EstimationStereo MatchingA Portable Multiscopic Camera for Novel View and Time Synthesis in Dynamic Scenes
We present a portable multiscopic camera system with a dedicated model for novel view and time synthesis in dynamic scenes. Our goal is to render high-quality images for a dynamic scene from any viewpoint at any time usi…
NeRFPriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation
Traditional monocular depth estimation suffers from inherent ambiguity and visual nuisance. We argue that language prior can enhance monocular depth estimation by leveraging the inductive bias learned during the text-to-…
DenoisingDepth EstimationInductive BiasMonocular Depth EstimationRadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale
We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings,…
Depth EstimationDepth Prediction