Vector Field Attention for Deformable Image Registration
Deformable image registration establishes non-linear spatial correspondences between fixed and moving images. Deep learning-based deformable registration methods have been widely studied in recent years due to their speed advantage over traditional algorithms as well as their better accuracy. Most existing deep learning-based methods require neural networks to encode location information in their feature maps and predict displacement or deformation fields though convolutional or fully connected layers from these high-dimensional feature maps. In this work, we present Vector Field Attention (VFA), a novel framework that enhances the efficiency of the existing network design by enabling direct retrieval of location correspondences. VFA uses neural networks to extract multi-resolution feature maps from the fixed and moving images and then retrieves pixel-level correspondences based on feature similarity. The retrieval is achieved with a novel attention module without the need of learnable parameters. VFA is trained end-to-end in either a supervised or unsupervised manner. We evaluated VFA for intra- and inter-modality registration and for unsupervised and semi-supervised registration using public datasets, and we also evaluated it on the Learn2Reg challenge. Experimental results demonstrate the superior performance of VFA compared to existing methods. The source code of VFA is publicly available at https://github.com/yihao6/vfa/.
Code (1)
Tasks
Image RegistrationRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet a…
Image RegistrationDeformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration
Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convol…
Image RegistrationMedical Image RegistrationA Hybrid Deep Feature-Based Deformable Image Registration Method for Pathology Images
Pathologists need to combine information from differently stained pathology slices for accurate diagnosis. Deformable image registration is a necessary technique for fusing multi-modal pathology slices. This paper propos…
Image RegistrationOutlier DetectionCycleMorph: Cycle Consistent Unsupervised Deformable Image Registration
Image registration is a fundamental task in medical image analysis. Recently, deep learning based image registration methods have been extensively investigated due to their excellent performance despite the ultra-fast co…
Image RegistrationMedical Image AnalysisMedical Image Registration via Neural Fields
Image registration is an essential step in many medical image analysis tasks. Traditional methods for image registration are primarily optimization-driven, finding the optimal deformations that maximize the similarity be…
Image RegistrationMedical Image AnalysisMedical Image RegistrationModel Optimization