paper-with-me

홈 › Papers

ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration

2021-04-13 · Junyu Chen, Yufan He, Eric C. Frey, Ye Li, Yong Du

In the last decade, convolutional neural networks (ConvNets) have dominated and achieved state-of-the-art performances in a variety of medical imaging applications. However, the performances of ConvNets are still limited by lacking the understanding of long-range spatial relations in an image. The recently proposed Vision Transformer (ViT) for image classification uses a purely self-attention-based model that learns long-range spatial relations to focus on the relevant parts of an image. Nevertheless, ViT emphasizes the low-resolution features because of the consecutive downsamplings, result in a lack of detailed localization information, making it unsuitable for image registration. Recently, several ViT-based image segmentation methods have been combined with ConvNets to improve the recovery of detailed localization information. Inspired by them, we present ViT-V-Net, which bridges ViT and ConvNet to provide volumetric medical image registration. The experimental results presented here demonstrate that the proposed architecture achieves superior performance to several top-performing registration methods.

📄 PDF Abstract BibTeX arXiv:2104.06468

Code (1)

junyuchen245/ViT-V-Net_for_3D_Image_Registration_Pytorch 공식 구현 pytorch

Tasks

image-classificationImage ClassificationImage RegistrationImage SegmentationMedical Image RegistrationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음

Similar Papers 제목 키워드 기반

TransMorph: Transformer for unsupervised medical image registration

2021-11-19 · Junyu Chen, Eric C. Frey, Yufan He, William P. Segars 외

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the …

Image RegistrationMedical Image AnalysisMedical Image Registration

Read Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretation

2024-12-18 · Changsun Lee, Sangjoon Park, Cheong-Il Shin, Woo Hee Choi 외

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. A…

Language ModelingLanguage Modelling

TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images

2022-01-30 · Jiangyun Li, Wenxuan Wang, Chen Chen, Tianxiang Zhang 외

Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capabl…

Brain Tumor SegmentationImage SegmentationInductive BiasMedical Image Segmentation+3

A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image

2020-02-28 · CVPR 2020 6 · Yuyu Guo, Lei Bi, Euijoon Ahn, Dagan Feng 외

Dynamic medical imaging is usually limited in application due to the large radiation doses and longer image scanning and reconstruction times. Existing methods attempt to reduce the dynamic sequence by interpolating the …

Anatomy

VolDiT: Controllable Volumetric Medical Image Synthesis with Diffusion Transformers

2026-03-26 · Marvin Seyfarth, Salman Ul Hassan Dar, Yannik Frisch, Philipp Wild 외 arxiv

Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion fram…

Medical Image Generation