paper-with-me

홈 › Papers

Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation

2022-01-12 · Masahiro Oda, Hayato Itoh, Kiyohito Tanaka, Hirotsugu TAKABATAKE, Masaki MORI, Hiroshi NATORI, Kensaku MORI

We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including Lambertian surface translation from unpaired data and depth estimation. The texture and specular reflection on the surface of an organ reduce the accuracy of depth estimations. We apply Lambertian surface translation to an endoscopic image to remove these texture and reflections. Then, we estimate the depth by using a fully convolutional network (FCN). During the training of the FCN, improvement of the object edge similarity between an estimated image and a ground truth depth image is important for getting better results. We introduced a muti-scale edge loss function to improve the accuracy of depth estimation. We quantitatively evaluated the proposed method using real colonoscopic images. The estimated depth values were proportional to the real depth values. Furthermore, we applied the estimated depth images to automated anatomical location identification of colonoscopic images using a convolutional neural network. The identification accuracy of the network improved from 69.2% to 74.1% by using the estimated depth images.

📄 PDF Abstract BibTeX arXiv:2201.04485

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationDomain AdaptationTranslation

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

Photometric single-view dense 3D reconstruction in endoscopy

2022-04-19 · Victor M. Batlle, J. M. M. Montiel, Juan D. Tardos

Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale…

3D ReconstructionDepth Estimation

Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction

2025-08-15 · Muzammil Khan, Enzo Kerkhof, Matteo Fusaglia, Koert Kuhlmann 외 arxiv

Accurate endoscope pose estimation and 3D tissue surface reconstruction significantly enhances monocular minimally invasive surgical procedures by enabling accurate navigation and improved spatial awareness. However, mon…

Pose Estimation

Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization

2021-07-28 · Aji Resindra Widya, Yusuke Monno, Masatoshi Okutomi, Sho Suzuki 외

Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that gastroendoscopy has a lot of advantages f…

3D ReconstructionPose Estimation

EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model

2025-10-25 · Changhao Zhang, Matthew J. Clarkson, Mobarak I. Hoque arxiv

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging…

Monocular Depth Estimation3D Reconstruction

Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos

2024-03-26 · Akshay Paruchuri, Samuel Ehrenstein, Shuxian Wang, Inbar Fried 외

Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural ima…

Depth EstimationMonocular Depth EstimationTransfer Learning