Explainable unsupervised multi-modal image registration using deep networks
Clinical decision making from magnetic resonance imaging (MRI) combines complementary information from multiple MRI sequences (defined as 'modalities'). MRI image registration aims to geometrically 'pair' diagnoses from different modalities, time points and slices. Both intra- and inter-modality MRI registration are essential components in clinical MRI settings. Further, an MRI image processing pipeline that can address both afine and non-rigid registration is critical, as both types of deformations may be occuring in real MRI data scenarios. Unlike image classification, explainability is not commonly addressed in image registration deep learning (DL) methods, as it is challenging to interpet model-data behaviours against transformation fields. To properly address this, we incorporate Grad-CAM-based explainability frameworks in each major component of our unsupervised multi-modal and multi-organ image registration DL methodology. We previously demonstrated that we were able to reach superior performance (against the current standard Syn method). In this work, we show that our DL model becomes fully explainable, setting the framework to generalise our approach on further medical imaging data.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision Makingimage-classificationImage ClassificationImage RegistrationSimilar Papers 제목 키워드 기반
KLDivNet: An unsupervised neural network for multi-modality image registration
Multi-modality image registration is one of the most underlined processes in medical image analysis. Recently, convolutional neural networks (CNNs) have shown significant potential in deformable registration. However, th…
Image RegistrationMedical Image AnalysisMedical Image RegistrationUnsupervised Deformable Registration for Multi-Modal Images via Disentangled Representations
We propose a fully unsupervised multi-modal deformable image registration method (UMDIR), which does not require any ground truth deformation fields or any aligned multi-modal image pairs during training. Multi-modal reg…
Image RegistrationImage-to-Image TranslationMedical Image AnalysisUnsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation
In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registrati…
Computed Tomography (CT)Image RegistrationImage-to-Image TranslationMedical Image Registration+1Collaborative Learning for Unsupervised Multimodal Remote Sensing Image Registration: Integrating Self-Supervision and MIM-Guided Diffusion-Based Image Translation
The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods h…
Image RegistrationPseudo LabelMutual information neural estimation for unsupervised multi-modal registration of brain images
Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superi…
Deep LearningImage Registration