Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery
This paper reports a CPU-level real-time stereo matching method for surgical images (10 Hz on 640 * 480 image with a single core of i5-9400). The proposed method is built on the fast ''dense inverse searching'' algorithm, which estimates the disparity of the stereo images. The overlapping image patches (arbitrary squared image segment) from the images at different scales are aligned based on the photometric consistency presumption. We propose a Bayesian framework to evaluate the probability of the optimized patch disparity at different scales. Moreover, we introduce a spatial Gaussian mixed probability distribution to address the pixel-wise probability within the patch. In-vivo and synthetic experiments show that our method can handle ambiguities resulted from the textureless surfaces and the photometric inconsistency caused by the Lambertian reflectance. Our Bayesian method correctly balances the probability of the patch for stereo images at different scales. Experiments indicate that the estimated depth has higher accuracy and fewer outliers than the baseline methods in the surgical scenario.
Code (1)
Tasks
CPUStereo MatchingSimilar Papers 제목 키워드 기반
BDIS: Bayesian Dense Inverse Searching Method for Real-Time Stereo Surgical Image Matching
In stereoscope-based Minimally Invasive Surgeries (MIS), dense stereo matching plays an indispensable role in 3D shape recovery, AR, VR, and navigation tasks. Although numerous Deep Neural Network (DNN) approaches are pr…
CPUGPUStereo MatchingBDIS-SLAM: A lightweight CPU-based dense stereo SLAM for surgery
Purpose: Common dense stereo Simultaneous Localization and Mapping (SLAM) approaches in Minimally Invasive Surgery (MIS) require high-end parallel computational resources for real-time implementation. Yet, it is not alwa…
CPUSimultaneous Localization and MappingStereo MatchingLearning an Optimization Algorithm through Human Design Iterations
Solving optimal design problems through crowdsourcing faces a dilemma: On one hand, human beings have been shown to be more effective than algorithms at searching for good solutions of certain real-world problems with hi…
Bayesian OptimizationInverse Renormalization Group Transformation in Bayesian Image Segmentations
A new Bayesian image segmentation algorithm is proposed by combining a loopy belief propagation with an inverse real space renormalization group transformation to reduce the computational time. In results of our experime…
Image SegmentationSegmentationSemantic SegmentationBayesian Rain Field Reconstruction using Commercial Microwave Links and Diffusion Model Priors
Commercial Microwave Links (CMLs) offer dense spatial coverage for rainfall sensing but produce path-integrated measurements that make accurate ground-level reconstruction challenging. Existing methods typically oversimp…
Gaussian Processes