paper-with-me

홈 › Papers

Unsupervised Echocardiography Registration through Patch-based MLPs and Transformers

2022-11-21 · ZiHao Wang, Yingyu Yang, Maxime Sermesant, Herve Delingette

Image registration is an essential but challenging task in medical image computing, especially for echocardiography, where the anatomical structures are relatively noisy compared to other imaging modalities. Traditional (non-learning) registration approaches rely on the iterative optimization of a similarity metric which is usually costly in time complexity. In recent years, convolutional neural network (CNN) based image registration methods have shown good effectiveness. In the meantime, recent studies show that the attention-based model (e.g., Transformer) can bring superior performance in pattern recognition tasks. In contrast, whether the superior performance of the Transformer comes from the long-winded architecture or is attributed to the use of patches for dividing the inputs is unclear yet. This work introduces three patch-based frameworks for image registration using MLPs and transformers. We provide experiments on 2D-echocardiography registration to answer the former question partially and provide a benchmark solution. Our results on a large public 2D echocardiography dataset show that the patch-based MLP/Transformer model can be effectively used for unsupervised echocardiography registration. They demonstrate comparable and even better registration performance than a popular CNN registration model. In particular, patch-based models better preserve volume changes in terms of Jacobian determinants, thus generating robust registration fields with less unrealistic deformation. Our results demonstrate that patch-based learning methods, whether with attention or not, can perform high-performance unsupervised registration tasks with adequate time and space complexity. Our codes are available https://gitlab.inria.fr/epione/mlp\_transformer\_registration

📄 PDF Abstract BibTeX arXiv:2211.11687

Code (0)

등록된 구현이 없습니다.

Tasks

Image Registration

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

PC-SwinMorph: Patch Representation for Unsupervised Medical Image Registration and Segmentation

2022-03-10 · Lihao Liu, Zhening Huang, Pietro Liò, Carola-Bibiane Schönlieb 외

Medical image registration and segmentation are critical tasks for several clinical procedures. Manual realisation of those tasks is time-consuming and the quality is highly dependent on the level of expertise of the phy…

Image RegistrationMedical Image Registration

Unsupervised Deep Feature Learning for Deformable Registration of MR Brain Images

2013-03-01 · MICCAI 2013 3 · Guorong WuMinjeong KimQian WangYaozong GaoShu LiaoDinggang Shen

Establishing accurate anatomical correspondences is critical for medical image registration. Although many hand-engineered features have been proposed for correspondence detection in various registration applications, no…

Image RegistrationMedical Image Registration

Multi-scale, Data-driven and Anatomically Constrained Deep Learning Image Registration for Adult and Fetal Echocardiography

2023-09-02 · Md. Kamrul Hasan, Haobo Zhu, Guang Yang, Choon Hwai Yap

Temporal echocardiography image registration is a basis for clinical quantifications such as cardiac motion estimation, myocardial strain assessments, and stroke volume quantifications. In past studies, deep learning ima…

Image RegistrationMotion EstimationOptical Flow Estimation

Fast Diffeomorphic Image Registration using Patch based Fully Convolutional Networks

2024-04-05 · Jiong Wu, Shuang Zhou, Li Lin, Xin Wang 외

Diffeomorphic image registration is a fundamental step in medical image analysis, owing to its capability to ensure the invertibility of transformations and preservation of topology. Currently, unsupervised learning-base…

Image RegistrationMedical Image Analysis

A New Semi-Automated Algorithm for Volumetric Segmentation of the Left Ventricle in Temporal 3D Echocardiography Sequences

2021-09-02 · Deepa Krishnaswamy, Abhilash R. Hareendranathan, Tan Suwatanaviroj, Pierre Boulanger 외

Purpose: Echocardiography is commonly used as a non-invasive imaging tool in clinical practice for the assessment of cardiac function. However, delineation of the left ventricle is challenging due to the inherent propert…