paper-with-me

Papers

LDM-Morph: Latent diffusion model guided deformable image registration

2024-11-23 · Jiong Wu, Kuang Gong

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features to predict the deformations. However, the lack of semantic information in the learned features limits the registration performance. Furthermore, the similarity metric of the loss function is often evaluated only in the pixel space, which ignores the matching of high-level anatomical features and can lead to deformation folding. To address these issues, in this work, we proposed LDM-Morph, an unsupervised deformable registration algorithm for medical image registration. LDM-Morph integrated features extracted from the latent diffusion model (LDM) to enrich the semantic information. Additionally, a latent and global feature-based cross-attention module (LGCA) was designed to enhance the interaction of semantic information from LDM and global information from multi-head self-attention operations. Finally, a hierarchical metric was proposed to evaluate the similarity of image pairs in both the original pixel space and latent-feature space, enhancing topology preservation while improving registration accuracy. Extensive experiments on four public 2D cardiac image datasets show that the proposed LDM-Morph framework outperformed existing state-of-the-art CNNs- and Transformers-based registration methods regarding accuracy and topology preservation with comparable computational efficiency. Our code is publicly available at https://github.com/wujiong-hub/LDM-Morph.

📄 PDF Abstract BibTeX arXiv:2411.15426

Code (1)

wujiong-hub/ldm-morph 공식 구현 pytorch

Tasks

Computational EfficiencyImage RegistrationMedical Image RegistrationMORPH

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Model

2021-12-09 · Boah Kim, Inhwa Han, Jong Chul Ye

Deformable image registration is one of the fundamental tasks in medical imaging. Classical registration algorithms usually require a high computational cost for iterative optimizations. Although deep-learning-based meth…

Image RegistrationMedical Image Registration

FSDiffReg: Feature-wise and Score-wise Diffusion-guided Unsupervised Deformable Image Registration for Cardiac Images

2023-07-22 · Yi Qin, Xiaomeng Li

Unsupervised deformable image registration is one of the challenging tasks in medical imaging. Obtaining a high-quality deformation field while preserving deformation topology remains demanding amid a series of deep-lear…

Image Registration

NestedMorph: Enhancing Deformable Medical Image Registration with Nested Attention Mechanisms

2024-10-03 · Gurucharan Marthi Krishna Kumar, Janine Mendola, Amir Shmuel

Deformable image registration is crucial for aligning medical images in a nonlinear fashion across different modalities, allowing for precise spatial correspondence between varying anatomical structures. This paper prese…

DecoderDeformable Medical Image RegistrationDiffusion MRIImage Registration+2

D-Cubed: Latent Diffusion Trajectory Optimisation for Dexterous Deformable Manipulation

2024-03-19 · Jun Yamada, Shaohong Zhong, Jack Collins, Ingmar Posner

Mastering dexterous robotic manipulation of deformable objects is vital for overcoming the limitations of parallel grippers in real-world applications. Current trajectory optimisation approaches often struggle to solve s…

Deformable Object Manipulation

PinchBot: Long-Horizon Deformable Manipulation with Guided Diffusion Policy

2025-07-23 · Alison Bartsch, Arvind Car, Amir Barati Farimani arxiv

Pottery creation is a complicated art form that requires dexterous, precise and delicate actions to slowly morph a block of clay to a meaningful, and often useful 3D goal shape. In this work, we aim to create a robotic s…