paper-with-me

Papers

Affine Medical Image Registration with Coarse-to-Fine Vision Transformer

2022-03-29 · CVPR 2022 1 · Tony C. W. Mok, Albert C. S. Chung

Affine registration is indispensable in a comprehensive medical image registration pipeline. However, only a few studies focus on fast and robust affine registration algorithms. Most of these studies utilize convolutional neural networks (CNNs) to learn joint affine and non-parametric registration, while the standalone performance of the affine subnetwork is less explored. Moreover, existing CNN-based affine registration approaches focus either on the local misalignment or the global orientation and position of the input to predict the affine transformation matrix, which are sensitive to spatial initialization and exhibit limited generalizability apart from the training dataset. In this paper, we present a fast and robust learning-based algorithm, Coarse-to-Fine Vision Transformer (C2FViT), for 3D affine medical image registration. Our method naturally leverages the global connectivity and locality of the convolutional vision transformer and the multi-resolution strategy to learn the global affine registration. We evaluate our method on 3D brain atlas registration and template-matching normalization. Comprehensive results demonstrate that our method is superior to the existing CNNs-based affine registration methods in terms of registration accuracy, robustness and generalizability while preserving the runtime advantage of the learning-based methods. The source code is available at https://github.com/cwmok/C2FViT.

📄 PDF Abstract BibTeX arXiv:2203.15216

Code (1)

cwmok/C2FViT 공식 구현 pytorch

Tasks

Image RegistrationMedical Image RegistrationTemplate Matching

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration

2023-07-07 · Mingyuan Meng, Lei Bi, Michael Fulham, Dagan Feng 외

Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Man…

Image RegistrationMedical Image Analysis

A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration

2018-09-17 · Bob D. de Vos, Floris F. Berendsen, Max A. Viergever, Hessam Sokooti 외

Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neu…

Affine Image RegistrationDeep LearningImage RegistrationMedical Image Analysis

Deep learning in medical image registration: introduction and survey

2023-09-01 · Ahmad Hammoudeh, Stéphane Dupont

Image registration (IR) is a process that deforms images to align them with respect to a reference space, making it easier for medical practitioners to examine various medical images in a standardized reference frame, su…

Deep LearningImage RegistrationMedical Image RegistrationSurvey

Networks for Joint Affine and Non-parametric Image Registration

2019-03-21 · CVPR 2019 6 · Zhengyang Shen, Xu Han, Zhenlin Xu, Marc Niethammer

We introduce an end-to-end deep-learning framework for 3D medical image registration. In contrast to existing approaches, our framework combines two registration methods: an affine registration and a vector momentum-para…

Image RegistrationMedical Image Registration

Coarse-to-Fine Joint Registration of MR and Ultrasound Images via Imaging Style Transfer

2025-08-07 · Junyi Wang, Xi Zhu, Yikun Guo, Zixi Wang 외 arxiv

We developed a pipeline for registering pre-surgery Magnetic Resonance (MR) images and post-resection Ultrasound (US) images. Our approach leverages unpaired style transfer using 3D CycleGAN to generate synthetic T1 imag…

Style Transfer