paper-with-me

Papers

TransMorph: Transformer for unsupervised medical image registration

2021-11-19 · Junyu Chen, Eric C. Frey, Yufan He, William P. Segars, Ye Li, Yong Du

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial relationships in an image. Recently Vision Transformer architectures have been proposed to address the shortcomings of ConvNets and have produced state-of-the-art performances in many medical imaging applications. Transformers may be a strong candidate for image registration because their substantially larger receptive field enables a more precise comprehension of the spatial correspondence between moving and fixed images. Here, we present TransMorph, a hybrid Transformer-ConvNet model for volumetric medical image registration. This paper also presents diffeomorphic and Bayesian variants of TransMorph: the diffeomorphic variants ensure the topology-preserving deformations, and the Bayesian variant produces a well-calibrated registration uncertainty estimate. We extensively validated the proposed models using 3D medical images from three applications: inter-patient and atlas-to-patient brain MRI registration and phantom-to-CT registration. The proposed models are evaluated in comparison to a variety of existing registration methods and Transformer architectures. Qualitative and quantitative results demonstrate that the proposed Transformer-based model leads to a substantial performance improvement over the baseline methods, confirming the effectiveness of Transformers for medical image registration.

📄 PDF Abstract BibTeX arXiv:2111.10480

Code (2)

junyuchen245/TransMorph_Transformer_for_Medical_Image_Registration 공식 구현 pytorch
rohitrango/dio pytorch

Tasks

Image RegistrationMedical Image AnalysisMedical Image Registration

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?

2022-08-07 · Xi Jia, Joseph Bartlett, Tianyang Zhang, Wenqi Lu 외

Due to their extreme long-range modeling capability, vision transformer-based networks have become increasingly popular in deformable image registration. We believe, however, that the receptive field of a 5-layer convolu…

Image RegistrationLong-range modelingMedical Image Registration

3D Inception-Based TransMorph: Pre- and Post-operative Multi-contrast MRI Registration in Brain Tumors

2022-12-08 · Javid Abderezaei, Aymeric Pionteck, Agamdeep Chopra, Mehmet Kurt

Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the sam…

Image RegistrationMedical Image Analysis

Decoder-Only Image Registration

2024-02-05 · Xi Jia, Wenqi Lu, Xinxing Cheng, Jinming Duan

In unsupervised medical image registration, the predominant approaches involve the utilization of a encoder-decoder network architecture, allowing for precise prediction of dense, full-resolution displacement fields from…

DecoderImage RegistrationMedical Image Registration

Fine-Tuning TransMorph with Gradient Correlation for Anatomical Alignment

2024-12-30 · Lukas Förner, Kartikay Tehlan, Thomas Wendler

Unsupervised deep learning is a promising method in brain MRI registration to reduce the reliance on anatomical labels, while still achieving anatomically accurate transformations. For the Learn2Reg2024 LUMIR challenge, …

NestedMorph: Enhancing Deformable Medical Image Registration with Nested Attention Mechanisms

2024-10-03 · Gurucharan Marthi Krishna Kumar, Janine Mendola, Amir Shmuel

Deformable image registration is crucial for aligning medical images in a nonlinear fashion across different modalities, allowing for precise spatial correspondence between varying anatomical structures. This paper prese…

DecoderDeformable Medical Image RegistrationDiffusion MRIImage Registration+2