Self-Supervised Light Field Depth Estimation Using Epipolar Plane Images
Exploiting light field data makes it possible to obtain dense and accurate depth map. However, synthetic scenes with limited disparity range cannot contain the diversity of real scenes. By training in synthetic data, current learning-based methods do not perform well in real scenes. In this paper, we propose a self-supervised learning framework for light field depth estimation. Different from the existing end-to-end training methods using disparity label per pixel, our approach implements network training by estimating EPI disparity shift after refocusing, which extends the disparity range of epipolar lines. To reduce the sensitivity of EPI to noise, we propose a new input mode called EPI-Stack, which stacks EPIs in the view dimension. This method is less sensitive to noise scenes than traditional input mode and improves the efficiency of estimation. Compared with other state-of-the-art methods, the proposed method can also obtain higher quality results in real-world scenarios, especially in the complex occlusion and depth discontinuity.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationDiversitySelf-Supervised LearningSimilar Papers 제목 키워드 기반
DeLightMono: Enhancing Self-Supervised Monocular Depth Estimation in Endoscopy by Decoupling Uneven Illumination
Self-supervised monocular depth estimation serves as a key task in the development of endoscopic navigation systems. However, performance degradation persists due to uneven illumination inherent in endoscopic images, par…
Monocular Depth EstimationAutonomous DrivingMonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformer
Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task.…
Depth EstimationDepth PredictionMonocular Depth EstimationUnsupervised Monocular Depth EstimationThe Second Monocular Depth Estimation Challenge
This paper discusses the results for the second edition of the Monocular Depth Estimation Challenge (MDEC). This edition was open to methods using any form of supervision, including fully-supervised, self-supervised, mul…
Depth EstimationDiversityMonocular Depth EstimationRTS-Mono: A Real-Time Self-Supervised Monocular Depth Estimation Method for Real-World Deployment
Depth information is crucial for autonomous driving and intelligent robot navigation. The simplicity and flexibility of self-supervised monocular depth estimation are conducive to its role in these fields. However, most …
Monocular Depth EstimationAutonomous DrivingRobot NavigationLeveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos
Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural ima…
Depth EstimationMonocular Depth EstimationTransfer Learning