Self-supervised Learning for Dense Depth Estimation in Monocular Endoscopy
We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires sequential data from monocular endoscopic videos and a multi-view stereo reconstruction method, e.g. structure from motion, that supervises learning in a sparse but accurate manner. Consequently, our method requires neither manual interaction, such as scaling or labeling, nor patient CT in the training and application phases. We demonstrate the performance of our method on sinus endoscopy data from two patients and validate depth prediction quantitatively using corresponding patient CT scans where we found submillimeter residual errors.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyDepth EstimationDepth PredictionSelf-Supervised LearningSimilar Papers 제목 키워드 기반
LiDARTouch: Monocular metric depth estimation with a few-beam LiDAR
Vision-based depth estimation is a key feature in autonomous systems, which often relies on a single camera or several independent ones. In such a monocular setup, dense depth is obtained with either additional input fro…
Depth CompletionDepth EstimationDense Depth Estimation in Monocular Endoscopy with Self-supervised Learning Methods
We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular…
AnatomyComputed Tomography (CT)Depth EstimationSelf-Supervised Learning3D Packing for Self-Supervised Monocular Depth Estimation
Although cameras are ubiquitous, robotic platforms typically rely on active sensors like LiDAR for direct 3D perception. In this work, we propose a novel self-supervised monocular depth estimation method combining geomet…
Depth EstimationInductive BiasMonocular Depth EstimationSelf-Driving CarsRA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimation
Existing self-supervised monocular depth estimation methods can get rid of expensive annotations and achieve promising results. However, these methods suffer from severe performance degradation when directly adopting a m…
Data AugmentationDecoderDepth EstimationMonocular Depth EstimationRobust Semi-Supervised Monocular Depth Estimation with Reprojected Distances
Dense depth estimation from a single image is a key problem in computer vision, with exciting applications in a multitude of robotic tasks. Initially viewed as a direct regression problem, requiring annotated labels as s…
Depth EstimationMonocular Depth Estimationvalid