paper-with-me

Papers

Towards real-time unsupervised monocular depth estimation on CPU

2018-06-29 · Matteo Poggi, Filippo Aleotti, Fabio Tosi, Stefano Mattoccia

Unsupervised depth estimation from a single image is a very attractive technique with several implications in robotic, autonomous navigation, augmented reality and so on. This topic represents a very challenging task and the advent of deep learning enabled to tackle this problem with excellent results. However, these architectures are extremely deep and complex. Thus, real-time performance can be achieved only by leveraging power-hungry GPUs that do not allow to infer depth maps in application fields characterized by low-power constraints. To tackle this issue, in this paper we propose a novel architecture capable to quickly infer an accurate depth map on a CPU, even of an embedded system, using a pyramid of features extracted from a single input image. Similarly to state-of-the-art, we train our network in an unsupervised manner casting depth estimation as an image reconstruction problem. Extensive experimental results on the KITTI dataset show that compared to the top performing approach our network has similar accuracy but a much lower complexity (about 6% of parameters) enabling to infer a depth map for a KITTI image in about 1.7 s on the Raspberry Pi 3 and at more than 8 Hz on a standard CPU. Moreover, by trading accuracy for efficiency, our network allows to infer maps at about 2 Hz and 40 Hz respectively, still being more accurate than most state-of-the-art slower methods. To the best of our knowledge, it is the first method enabling such performance on CPUs paving the way for effective deployment of unsupervised monocular depth estimation even on embedded systems.

📄 PDF Abstract BibTeX arXiv:1806.11430

Code (4)

mattpoggi/pydnet 공식 구현 tf
FilippoAleotti/mobilePydnet
Pomu0708/PyDnet tf
dronefreak/dji-tello-collision-avoidance-pydnet tf

Tasks

Autonomous NavigationCPUDepth EstimationImage ReconstructionMonocular Depth EstimationRaspberry Pi 3Unsupervised Monocular Depth Estimation

Similar Papers 제목 키워드 기반

MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation

2020-06-27 · Jun Liu, Qing Li, Rui Cao, Wenming Tang 외

Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effectiv…

CPUDepth EstimationDepth PredictionGPU+4

Unsupervised monocular stereo matching

2018-12-31 · Zhimin Zhang, Jianzhong Qiao, Shukuan Lin

At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based …

Depth EstimationMonocular Depth EstimationStereo MatchingStereo Matching Hand

Pseudo Supervised Monocular Depth Estimation with Teacher-Student Network

2021-10-22 · Huan Liu, Junsong Yuan, Chen Wang, Jun Chen

Despite recent improvement of supervised monocular depth estimation, the lack of high quality pixel-wise ground truth annotations has become a major hurdle for further progress. In this work, we propose a new unsupervise…

Depth EstimationKnowledge DistillationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

FusionDepth: Complement Self-Supervised Monocular Depth Estimation with Cost Volume

2023-05-10 · Zhuofei Huang, Jianlin Liu, Shang Xu, Ying Chen 외

Multi-view stereo depth estimation based on cost volume usually works better than self-supervised monocular depth estimation except for moving objects and low-textured surfaces. So in this paper, we propose a multi-frame…

Depth EstimationMonocular Depth EstimationStereo Depth Estimation

Back to the Color: Learning Depth to Specific Color Transformation for Unsupervised Depth Estimation

2024-06-11 · Yufan Zhu, Chongzhi Ran, Mingtao Feng, Fangfang Wu 외

Virtual engines can generate dense depth maps for various synthetic scenes, making them invaluable for training depth estimation models. However, discrepancies between synthetic and real-world colors pose significant cha…

Depth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation