XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attention
An effective backbone network is important to deep learning-based Deformable Medical Image Registration (DMIR), because it extracts and matches the features between two images to discover the mutual correspondence for fine registration. However, the existing deep networks focus on single image situation and are limited in registration task which is performed on paired images. Therefore, we advance a novel backbone network, XMorpher, for the effective corresponding feature representation in DMIR. 1) It proposes a novel full transformer architecture including dual parallel feature extraction networks which exchange information through cross attention, thus discovering multi-level semantic correspondence while extracting respective features gradually for final effective registration. 2) It advances the Cross Attention Transformer (CAT) blocks to establish the attention mechanism between images which is able to find the correspondence automatically and prompts the features to fuse efficiently in the network. 3) It constrains the attention computation between base windows and searching windows with different sizes, and thus focuses on the local transformation of deformable registration and enhances the computing efficiency at the same time. Without any bells and whistles, our XMorpher gives Voxelmorph 2.8% improvement on DSC , demonstrating its effective representation of the features from the paired images in DMIR. We believe that our XMorpher has great application potential in more paired medical images. Our XMorpher is open on https://github.com/Solemoon/XMorpher
Code (1)
Tasks
Deformable Medical Image RegistrationImage RegistrationMedical Image RegistrationSemantic correspondenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration
Deformable image registration is a fundamental step for medical image analysis. Recently, transformers have been used for registration and outperformed Convolutional Neural Networks (CNNs). Transformers can capture long-…
Deformable Medical Image RegistrationImage RegistrationInductive BiasMedical Image Analysis+1Advancing Deformable Medical Image Registration with Multi-axis Cross-covariance Attention
Deformable image registration is a fundamental requirement for medical image analysis. Recently, transformers have been widely used in deep learning-based registration methods for their ability to capture long-range depe…
Deformable Medical Image RegistrationImage RegistrationMedical Image AnalysisMedical Image RegistrationMaskMed: Decoupled Mask and Class Prediction for Medical Image Segmentation
Medical image segmentation typically adopts a point-wise convolutional segmentation head to predict dense labels, where each output channel is heuristically tied to a specific class. This rigid design limits both feature…
Medical Image SegmentationDeformable Cross-Attention Transformer for Medical Image Registration
Transformers have recently shown promise for medical image applications, leading to an increasing interest in developing such models for medical image registration. Recent advancements in designing registration Transform…
Image RegistrationMedical Image RegistrationBeyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation
Medical image segmentation has seen significant improvements with transformer models, which excel in grasping far-reaching contexts and global contextual information. However, the increasing computational demands of thes…
Image SegmentationMedical Image SegmentationSemantic Segmentation