Joint bi-modal image reconstruction of DOT and XCT with an extended Mumford-Shah functional
Feature similarity measures are indispensable for joint image reconstruction in multi-modality medical imaging, which enable joint multi-modal image reconstruction (JmmIR) by communication of feature information from one modality to another, and vice versa. In this work, we establish an image similarity measure in terms of image edges from Tversky's theory of feature similarity in psychology. For joint bi-modal image reconstruction (JbmIR), it is found that this image similarity measure is an extended Mumford-Shah functional with a-priori edge information proposed previously from the perspective of regularization approach. This image similarity measure consists of Hausdorff measures of the common and different parts of image edges from both modalities. By construction, it posits that two images are more similar if they have more common edges and fewer unique/distinctive features, and will not force the nonexistent structures to be reconstructed when applied to JbmIR. With the Gamma-approximation of the JbmIR functional, an alternating minimization method is proposed for the JbmIR of diffuse optical tomography and x-ray computed tomography. The performance of the proposed method is evaluated by three numerical phantoms. It is found that the proposed method improves the reconstructed image quality by more than 10% compared to single modality image reconstruction (SmIR) in terms of the structural similarity index measure (SSIM)
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionSSIMSimilar Papers 제목 키워드 기반
A New Model and Simple Algorithms for Multi-label Mumford-Shah Problems
In this work, we address the multi-label Mumford-Shah problem, i.e., the problem of jointly estimating a partitioning of the domain of the image, and functions defined within regions of the partition. We create algorithm…
DenoisingMotion SegmentationSegmentationCompressing Piecewise Smooth Images with the Mumford-Shah Cartoon Model
Compressing piecewise smooth images is important for many data types such as depth maps in 3D videos or optic flow fields for motion compensation. Specialised codecs that rely on explicitly stored segmentations excel in …
Motion CompensationHyperparameter selection for Discrete Mumford-Shah
This work focuses on a parameter-free joint piecewise smooth image denoising and contour detection. Formulated as the minimization of a discrete Mumford-Shah functional and estimated via a theoretically grounded alternat…
Contour DetectionDenoisingImage DenoisingImage ReconstructionMumford-Shah functionals on graphs and their asymptotics
We consider adaptations of the Mumford-Shah functional to graphs. These are based on discretizations of nonlocal approximations to the Mumford-Shah functional. Motivated by applications in machine learning we study the r…
BIG-bench Machine LearningMumford-Shah Loss Functional for Image Segmentation with Deep Learning
Recent state-of-the-art image segmentation algorithms are mostly based on deep neural networks, thanks to their high performance and fast computation time. However, these methods are usually trained in a supervised manne…
Deep LearningImage SegmentationSegmentationSemantic Segmentation+1