ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration
In the last decade, convolutional neural networks (ConvNets) have dominated and achieved state-of-the-art performances in a variety of medical imaging applications. However, the performances of ConvNets are still limited by lacking the understanding of long-range spatial relations in an image. The recently proposed Vision Transformer (ViT) for image classification uses a purely self-attention-based model that learns long-range spatial relations to focus on the relevant parts of an image. Nevertheless, ViT emphasizes the low-resolution features because of the consecutive downsamplings, result in a lack of detailed localization information, making it unsuitable for image registration. Recently, several ViT-based image segmentation methods have been combined with ConvNets to improve the recovery of detailed localization information. Inspired by them, we present ViT-V-Net, which bridges ViT and ConvNet to provide volumetric medical image registration. The experimental results presented here demonstrate that the proposed architecture achieves superior performance to several top-performing registration methods.
Code (1)
Tasks
image-classificationImage ClassificationImage RegistrationImage SegmentationMedical Image RegistrationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TransMorph: Transformer for unsupervised medical image registration
In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the …
Image RegistrationMedical Image AnalysisMedical Image RegistrationRead Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretation
Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. A…
Language ModelingLanguage ModellingTransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images
Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capabl…
Brain Tumor SegmentationImage SegmentationInductive BiasMedical Image Segmentation+3A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image
Dynamic medical imaging is usually limited in application due to the large radiation doses and longer image scanning and reconstruction times. Existing methods attempt to reduce the dynamic sequence by interpolating the …
AnatomyVolDiT: Controllable Volumetric Medical Image Synthesis with Diffusion Transformers
Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion fram…
Medical Image Generation