Virtual Blood Vessels in Complex Background using Stereo X-ray Images
We propose a fully automatic system to reconstruct and visualize 3D blood vessels in Augmented Reality (AR) system from stereo X-ray images with bones and body fat. Currently, typical 3D imaging technologies are expensive and carrying the risk of irradiation exposure. To reduce the potential harm, we only need to take two X-ray images before visualizing the vessels. Our system can effectively reconstruct and visualize vessels in following steps. We first conduct initial segmentation using Markov Random Field and then refine segmentation in an entropy based post-process. We parse the segmented vessels by extracting their centerlines and generating trees. We propose a coarse-to-fine scheme for stereo matching, including initial matching using affine transform and dense matching using Hungarian algorithm guided by Gaussian regression. Finally, we render and visualize the reconstructed model in a HoloLens based AR system, which can essentially change the way of visualizing medical data. We have evaluated its performance by using synthetic and real stereo X-ray images, and achieved satisfactory quantitative and qualitative results.
Code (0)
등록된 구현이 없습니다.
Tasks
Stereo MatchingStereo Matching HandSimilar Papers 제목 키워드 기반
A Hierarchical Image Matting Model for Blood Vessel Segmentation in Fundus images
In this paper, a hierarchical image matting model is proposed to extract blood vessels from fundus images. More specifically, a hierarchical strategy utilizing the continuity and extendibility of retinal blood vessels is…
Image MattingSegmentationDictionary-based Method for Vascular Segmentation for OCTA Images
Optical coherence tomography angiography (OCTA) is an imaging technique that allows for non-invasive investigation of the microvasculature in the retina. OCTA uses laser light reflectance to measure moving blood cells. H…
SegmentationApplication of Top-hat Transformation for Enhanced Blood Vessel Extraction
In the medical domain, different computer-aided diagnosis systems have been proposed to extract blood vessels from retinal fundus images for the clinical treatment of vascular diseases. Accurate extraction of blood vesse…
U-Net with Graph Based Smoothing Regularizer for Small Vessel Segmentation on Fundus Image
The detection of retinal blood vessels, especially the changes of small vessel condition is the most important indicator to identify the vascular network of the human body. Existing techniques focused mainly on shape of …
A Fully Convolutional Neural Network based Structured Prediction Approach Towards the Retinal Vessel Segmentation
Automatic segmentation of retinal blood vessels from fundus images plays an important role in the computer aided diagnosis of retinal diseases. The task of blood vessel segmentation is challenging due to the extreme vari…
Retinal Vessel SegmentationSegmentationStructured Prediction