Unsupervised Image Registration Towards Enhancing Performance and Explainability in Cardiac And Brain Image Analysis
Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, affine and non-rigid image registration is not extensively investigated using a single unsupervised model architecture. In our work, we present an un-supervised deep learning registration methodology which can accurately model affine and non-rigid trans-formations, simultaneously. Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms. To address inverse-consistency, our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent rep-resentations, while involves two factorised transformation networks and an inverse-consistency loss to learn topology-preserving anatomical transformations. Overall, our model (named "FIRE") shows improved performances against the reference standard baseline method on multi-modality brain 2D and 3D MRI and intra-modality cardiac 4D MRI data experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage RegistrationMedical Image AnalysisUnsupervised Image RegistrationSimilar Papers 제목 키워드 기반
Explainable unsupervised multi-modal image registration using deep networks
Clinical decision making from magnetic resonance imaging (MRI) combines complementary information from multiple MRI sequences (defined as 'modalities'). MRI image registration aims to geometrically 'pair' diagnoses from …
Decision Makingimage-classificationImage ClassificationImage RegistrationOn-the-Fly Guidance Training for Medical Image Registration
This study introduces a novel On-the-Fly Guidance (OFG) training framework for enhancing existing learning-based image registration models, addressing the limitations of weakly-supervised and unsupervised methods. Weakly…
Image RegistrationMedical Image RegistrationAMD Severity Prediction And Explainability Using Image Registration And Deep Embedded Clustering
We propose a method to predict severity of age related macular degeneration (AMD) from input optical coherence tomography (OCT) images. Although there is no standard clinical severity scale for AMD, we leverage deep lear…
ClusteringImage Registrationseverity predictionDual-Attention Frequency Fusion at Multi-Scale for Joint Segmentation and Deformable Medical Image Registration
Deformable medical image registration is a crucial aspect of medical image analysis. In recent years, researchers have begun leveraging auxiliary tasks (such as supervised segmentation) to provide anatomical structure in…
DecoderDeformable Medical Image RegistrationImage RegistrationMedical Image Analysis+3CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning
Image registration is a fundamental building block for various applications in medical image analysis. To better explore the correlation between the fixed and moving images and improve registration performance, we propos…
Image RegistrationMedical Image Analysis