Enhancing Bronchoscopy Depth Estimation through Synthetic-to-Real Domain Adaptation
Monocular depth estimation has shown promise in general imaging tasks, aiding in localization and 3D reconstruction. While effective in various domains, its application to bronchoscopic images is hindered by the lack of labeled data, challenging the use of supervised learning methods. In this work, we propose a transfer learning framework that leverages synthetic data with depth labels for training and adapts domain knowledge for accurate depth estimation in real bronchoscope data. Our network demonstrates improved depth prediction on real footage using domain adaptation compared to training solely on synthetic data, validating our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionDepth EstimationDepth PredictionDomain AdaptationMonocular Depth EstimationTransfer LearningSimilar Papers 제목 키워드 기반
BronchoGAN: Anatomically consistent and domain-agnostic image-to-image translation for video bronchoscopy
The limited availability of bronchoscopy images makes image synthesis particularly interesting for training deep learning models. Robust image translation across different domains -- virtual bronchoscopy, phantom as well…
Image-to-Image TranslationBREA-Depth: Bronchoscopy Realistic Airway-geometric Depth Estimation
Monocular depth estimation in bronchoscopy can significantly improve real-time navigation accuracy and enhance the safety of interventions in complex, branching airways. Recent advances in depth foundation models have sh…
Monocular Depth EstimationBronchOpt : Vision-Based Pose Optimization with Fine-Tuned Foundation Models for Accurate Bronchoscopy Navigation
Accurate intra-operative localization of the bronchoscope tip relative to patient anatomy remains challenging due to respiratory motion, anatomical variability, and CT-to-body divergence that cause deformation and misali…
Domain GeneralizationDD-VNB: A Depth-based Dual-Loop Framework for Real-time Visually Navigated Bronchoscopy
Real-time 6 DOF localization of bronchoscopes is crucial for enhancing intervention quality. However, current vision-based technologies struggle to balance between generalization to unseen data and computational speed. I…
Depth EstimationMonocular Depth EstimationMotion EstimationHarnessing Foundation Models for Robust and Generalizable 6-DOF Bronchoscopy Localization
Vision-based 6-DOF bronchoscopy localization offers a promising solution for accurate and cost-effective interventional guidance. However, existing methods struggle with 1) limited generalization across patient cases due…
Depth Estimation