Boosting Monocular Depth Estimation with Lightweight 3D Point Fusion
In this paper, we propose enhancing monocular depth estimation by adding 3D points as depth guidance. Unlike existing depth completion methods, our approach performs well on extremely sparse and unevenly distributed point clouds, which makes it agnostic to the source of the 3D points. We achieve this by introducing a novel multi-scale 3D point fusion network that is both lightweight and efficient. We demonstrate its versatility on two different depth estimation problems where the 3D points have been acquired with conventional structure-from-motion and LiDAR. In both cases, our network performs on par with state-of-the-art depth completion methods and achieves significantly higher accuracy when only a small number of points is used while being more compact in terms of the number of parameters. We show that our method outperforms some contemporary deep learning based multi-view stereo and structure-from-motion methods both in accuracy and in compactness.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth CompletionDepth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Lightweight Monocular Depth Estimation via Token-Sharing Transformer
Depth estimation is an important task in various robotics systems and applications. In mobile robotics systems, monocular depth estimation is desirable since a single RGB camera can be deployable at a low cost and compac…
Depth EstimationDepth PredictionMonocular Depth EstimationBoosting Monocular Metric Depth Estimation via Bokeh Rendering
Bokeh rendering and depth estimation share a fundamental optical connection, yet existing methods fail to fully exploit this reciprocity. Conventional bokeh pipelines rely heavily on noisy depth maps that inevitably intr…
Depth EstimationNVS-MonoDepth: Improving Monocular Depth Prediction with Novel View Synthesis
Building upon the recent progress in novel view synthesis, we propose its application to improve monocular depth estimation. In particular, we propose a novel training method split in three main steps. First, the predict…
Depth EstimationDepth PredictionImage GenerationMonocular Depth Estimation+1EndoDepthL: Lightweight Endoscopic Monocular Depth Estimation with CNN-Transformer
In this study, we address the key challenges concerning the accuracy and effectiveness of depth estimation for endoscopic imaging, with a particular emphasis on real-time inference and the impact of light reflections. We…
Depth EstimationMonocular Depth EstimationBoosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision
Recent advances in monocular 3D detection leverage a depth estimation network explicitly as an intermediate stage of the 3D detection network. Depth map approaches yield more accurate depth to objects than other methods …
3D Object DetectionDepth EstimationDepth PredictionMonocular 3D Object Detection+4