Projection-to-Projection Translation for Hybrid X-ray and Magnetic Resonance Imaging
Hybrid X-ray and magnetic resonance (MR) imaging promises large potential in interventional medical imaging applications due to the broad variety of contrast of MRI combined with fast imaging of X-ray-based modalities. To fully utilize the potential of the vast amount of existing image enhancement techniques, the corresponding information from both modalities must be present in the same domain. For image-guided interventional procedures, X-ray fluoroscopy has proven to be the modality of choice. Synthesizing one modality from another in this case is an ill-posed problem due to ambiguous signal and overlapping structures in projective geometry. To take on these challenges, we present a learning-based solution to MR to X-ray projection-to-projection translation. We propose an image generator network that focuses on high representation capacity in higher resolution layers to allow for accurate synthesis of fine details in the projection images. Additionally, a weighting scheme in the loss computation that favors high-frequency structures is proposed to focus on the important details and contours in projection imaging. The proposed extensions prove valuable in generating X-ray projection images with natural appearance. Our approach achieves a deviation from the ground truth of only $6$% and structural similarity measure of $0.913\,\pm\,0.005$. In particular the high frequency weighting assists in generating projection images with sharp appearance and reduces erroneously synthesized fine details.
Code (0)
등록된 구현이 없습니다.
Tasks
Image EnhancementTranslationSimilar Papers 제목 키워드 기반
MR to X-Ray Projection Image Synthesis
Hybrid imaging promises large potential in medical imaging applications. To fully utilize the possibilities of corresponding information from different modalities, the information must be transferable between the domains…
Image GenerationImage-to-Image TranslationTranslationTri-Hybrid Multi-User Precoding Based on Electromagnetically Reconfigurable Antennas
The tri-hybrid precoding architecture based on electromagnetically reconfigurable antennas (ERAs) is a promising solution for overcoming key limitations in multiple-input multiple-output communication systems. Aiming to …
Projection image-to-image translation in hybrid X-ray/MR imaging
The potential benefit of hybrid X-ray and MR imaging in the interventional environment is large due to the combination of fast imaging with high contrast variety. However, a vast amount of existing image enhancement meth…
Image EnhancementImage GenerationImage-to-Image TranslationTranslationTransfer Learning in 4D for Breast Cancer Diagnosis using Dynamic Contrast-Enhanced Magnetic Resonance Imaging
Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs…
Transfer LearningGreedy Approximate Projection for Magnetic Resonance Fingerprinting with Partial Volumes
In quantitative Magnetic Resonance Imaging, traditional methods suffer from the so-called Partial Volume Effect (PVE) due to spatial resolution limitations. As a consequence of PVE, the parameters of the voxels containin…
Magnetic Resonance Fingerprinting