paper-with-me

Papers

Explainable unsupervised multi-modal image registration using deep networks

2023-08-03 · Chengjia Wang, Giorgos Papanastasiou

Clinical decision making from magnetic resonance imaging (MRI) combines complementary information from multiple MRI sequences (defined as 'modalities'). MRI image registration aims to geometrically 'pair' diagnoses from different modalities, time points and slices. Both intra- and inter-modality MRI registration are essential components in clinical MRI settings. Further, an MRI image processing pipeline that can address both afine and non-rigid registration is critical, as both types of deformations may be occuring in real MRI data scenarios. Unlike image classification, explainability is not commonly addressed in image registration deep learning (DL) methods, as it is challenging to interpet model-data behaviours against transformation fields. To properly address this, we incorporate Grad-CAM-based explainability frameworks in each major component of our unsupervised multi-modal and multi-organ image registration DL methodology. We previously demonstrated that we were able to reach superior performance (against the current standard Syn method). In this work, we show that our DL model becomes fully explainable, setting the framework to generalise our approach on further medical imaging data.

📄 PDF Abstract BibTeX arXiv:2308.01994

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingimage-classificationImage ClassificationImage Registration

Similar Papers 제목 키워드 기반

KLDivNet: An unsupervised neural network for multi-modality image registration

2019-08-23 · Yechong Huang, Tao Song, Jiahang Xu, Yinan Chen 외

Multi-modality image registration is one of the most underlined processes in medical image analysis. Recently, convolutional neural networks (CNNs) have shown significant potential in deformable registration. However, th…

Image RegistrationMedical Image AnalysisMedical Image Registration

Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representations

2019-03-22 · Chen Qin, Bibo Shi, Rui Liao, Tommaso Mansi 외

We propose a fully unsupervised multi-modal deformable image registration method (UMDIR), which does not require any ground truth deformation fields or any aligned multi-modal image pairs during training. Multi-modal reg…

Image RegistrationImage-to-Image TranslationMedical Image Analysis

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

2022-04-28 · Zekang Chen, Jia Wei, Rui Li

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registrati…

Computed Tomography (CT)Image RegistrationImage-to-Image TranslationMedical Image Registration+1

Collaborative Learning for Unsupervised Multimodal Remote Sensing Image Registration: Integrating Self-Supervision and MIM-Guided Diffusion-Based Image Translation

2025-05-28 · Xiaochen Wei, Weiwei Guo, Wenxian Yu

The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods h…

Image RegistrationPseudo Label

Mutual information neural estimation for unsupervised multi-modal registration of brain images

2022-01-25 · Gerard Snaauw, Michele Sasdelli, Gabriel Maicas, Stephan Lau 외

Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superi…

Deep LearningImage Registration