multiGradICON: A Foundation Model for Multimodal Medical Image Registration
Modern medical image registration approaches predict deformations using deep networks. These approaches achieve state-of-the-art (SOTA) registration accuracy and are generally fast. However, deep learning (DL) approaches are, in contrast to conventional non-deep-learning-based approaches, anatomy-specific. Recently, a universal deep registration approach, uniGradICON, has been proposed. However, uniGradICON focuses on monomodal image registration. In this work, we therefore develop multiGradICON as a first step towards universal *multimodal* medical image registration. Specifically, we show that 1) we can train a DL registration model that is suitable for monomodal *and* multimodal registration; 2) loss function randomization can increase multimodal registration accuracy; and 3) training a model with multimodal data helps multimodal generalization. Our code and the multiGradICON model are available at https://github.com/uncbiag/uniGradICON.
Code (1)
Tasks
AnatomyDeep LearningImage RegistrationMedical Image RegistrationSimilar Papers 제목 키워드 기반
Generation of annotated multimodal ground truth datasets for abdominal medical image registration
Sparsity of annotated data is a major limitation in medical image processing tasks such as registration. Registered multimodal image data are essential for the diagnosis of medical conditions and the success of intervent…
Computed Tomography (CT)Image RegistrationImage SegmentationMedical Image Registration+1FMIR, a foundation model-based Image Registration Framework for Robust Image Registration
Deep learning has revolutionized medical image registration by achieving unprecedented speeds, yet its clinical application is hindered by a limited ability to generalize beyond the training domain, a critical weakness g…
Medical Image RegistrationIMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration
Image registration is fundamental in medical imaging, enabling precise alignment of anatomical structures for diagnosis, treatment planning, image-guided interventions, and longitudinal monitoring. This work introduces I…
Deformable Medical Image RegistrationImage RegistrationMedical Image RegistrationSemantic Similarity+1Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study
Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by speci…
Generative Adversarial NetworkImage RegistrationImage-to-Image TranslationRepresentation Learning+1Downstream Analysis of Foundational Medical Vision Models for Disease Progression
Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simpl…
Image RegistrationImage SegmentationMedical Image SegmentationSegmentation+1