paper-with-me

홈 › Papers

H-ViT: A Hierarchical Vision Transformer for Deformable Image Registration

2024-01-01 · CVPR 2024 1 · Morteza Ghahremani, Mohammad Khateri, Bailiang Jian, Benedikt Wiestler, Ehsan Adeli, Christian Wachinger

This paper introduces a novel top-down representation approach for deformable image registration which estimates the deformation field by capturing various short- and long-range flow features at different scale levels. As a Hierarchical Vision Transformer (H-ViT) we propose a dual self-attention and cross-attention mechanism that uses high-level features in the deformation field to represent low-level ones enabling information streams in the deformation field across all voxel patch embeddings irrespective of their spatial proximity. Since high-level features contain abstract flow patterns such patterns are expected to effectively contribute to the representation of the deformation field in lower scales. When the self-attention module utilizes within-scale short-range patterns for representation the cross-attention modules dynamically look for the key tokens across different scales to further interact with the local query voxel patches. Our method shows superior accuracy and visual quality over the state-of-the-art registration methods in five publicly available datasets highlighting a substantial enhancement in the performance of medical imaging registration. The project link is available at https://mogvision.github.io/hvit.

📄 PDF Abstract BibTeX

Code (1)

mogvision/hvit 공식 구현 pytorch

Tasks

Image Registration

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

LDM-Morph: Latent diffusion model guided deformable image registration

2024-11-23 · Jiong Wu, Kuang Gong

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers…

Computational EfficiencyImage RegistrationMedical Image RegistrationMORPH

Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration

2024-05-31 · CVPR 2024 1 · Mingyuan Meng, Dagan Feng, Lei Bi, Jinman Kim

Deformable image registration is a fundamental step for medical image analysis. Recently, transformers have been used for registration and outperformed Convolutional Neural Networks (CNNs). Transformers can capture long-…

Deformable Medical Image RegistrationImage RegistrationInductive BiasMedical Image Analysis+1

Advancing Deformable Medical Image Registration with Multi-axis Cross-covariance Attention

2024-12-24 · Mingyuan Meng, Michael Fulham, Lei Bi, Jinman Kim

Deformable image registration is a fundamental requirement for medical image analysis. Recently, transformers have been widely used in deep learning-based registration methods for their ability to capture long-range depe…

Deformable Medical Image RegistrationImage RegistrationMedical Image AnalysisMedical Image Registration

Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration

2023-07-07 · Mingyuan Meng, Lei Bi, Michael Fulham, Dagan Feng 외

Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Man…

Image RegistrationMedical Image Analysis

End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network

2017-04-20 · Bob D. de Vos, Floris F. Berendsen, Max A. Viergever, Marius Staring 외

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet a…

Image Registration