MobileDepth: Efficient Monocular Depth Prediction on Mobile Devices
Depth prediction is fundamental for many useful applications on computer vision and robotic systems. On mobile phones, the performance of some useful applications such as augmented reality, autofocus and so on could be enhanced by accurate depth prediction. In this work, an efficient fully convolutional network architecture for depth prediction has been proposed, which uses RegNetY 06 as the encoder and split-concatenate shuffle blocks as decoder. At the same time, an appropriate combination of data augmentation, hyper-parameters and loss functions to efficiently train the lightweight network has been provided. Also, an Android application has been developed which can load CNN models to predict depth map by the monocular images captured from the mobile camera and evaluate the average latency and frame per second of the models. As a result, the network achieves 82.7% {\delta}1 accuracy on NYU Depth v2 dataset and at the same time, have only 62ms latency on ARM A76 CPUs so that it can predict the depth map from the mobile camera in real-time.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDecoderDepth EstimationDepth PredictionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Lightweight Monocular Depth Estimation via Token-Sharing Transformer
Depth estimation is an important task in various robotics systems and applications. In mobile robotics systems, monocular depth estimation is desirable since a single RGB camera can be deployable at a low cost and compac…
Depth EstimationDepth PredictionMonocular Depth EstimationReal-time Monocular Depth Estimation with Sparse Supervision on Mobile
Monocular (relative or metric) depth estimation is a critical task for various applications, such as autonomous vehicles, augmented reality and image editing. In recent years, with the increasing availability of mobile d…
Autonomous VehiclesDepth EstimationGPUKnowledge Distillation+2Mobile AR Depth Estimation: Challenges & Prospects -- Extended Version
Metric depth estimation plays an important role in mobile augmented reality (AR). With accurate metric depth, we can achieve more realistic user interactions such as object placement and occlusion detection. While specia…
Depth EstimationMonocular Depth EstimationFusionMapping: Learning Depth Prediction with Monocular Images and 2D Laser Scans
Acquiring accurate three-dimensional depth information conventionally requires expensive multibeam LiDAR devices. Recently, researchers have developed a less expensive option by predicting depth information from two-dime…
Depth EstimationDepth PredictionMETER: a mobile vision transformer architecture for monocular depth estimation
Depth estimation is a fundamental knowledge for autonomous systems that need to assess their own state and perceive the surrounding environment. Deep learning algorithms for depth estimation have gained significant inter…
CPUData AugmentationDepth EstimationGPU+1