paper-with-me

Papers

Learning Generalized Non-Rigid Multimodal Biomedical Image Registration from Generic Point Set Data

2022-07-22 · Zachary MC Baum, Tamas Ungi, Christopher Schlenger, Yipeng Hu, Dean C Barratt

Free Point Transformer (FPT) has been proposed as a data-driven, non-rigid point set registration approach using deep neural networks. As FPT does not assume constraints based on point vicinity or correspondence, it may be trained simply and in a flexible manner by minimizing an unsupervised loss based on the Chamfer Distance. This makes FPT amenable to real-world medical imaging applications where ground-truth deformations may be infeasible to obtain, or in scenarios where only a varying degree of completeness in the point sets to be aligned is available. To test the limit of the correspondence finding ability of FPT and its dependency on training data sets, this work explores the generalizability of the FPT from well-curated non-medical data sets to medical imaging data sets. First, we train FPT on the ModelNet40 dataset to demonstrate its effectiveness and the superior registration performance of FPT over iterative and learning-based point set registration methods. Second, we demonstrate superior performance in rigid and non-rigid registration and robustness to missing data. Last, we highlight the interesting generalizability of the ModelNet-trained FPT by registering reconstructed freehand ultrasound scans of the spine and generic spine models without additional training, whereby the average difference to the ground truth curvatures is 1.3 degrees, across 13 patients.

📄 PDF Abstract BibTeX arXiv:2207.10994

Code (0)

등록된 구현이 없습니다.

Tasks

Image Registration

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Test 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Multimodality Biomedical Image Registration using Free Point Transformer Networks

2020-08-05 · Zachary M. C. Baum, Yipeng Hu, Dean C. Barratt

We describe a point-set registration algorithm based on a novel free point transformer (FPT) network, designed for points extracted from multimodal biomedical images for registration tasks, such as those frequently encou…

Image Registration

Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study

2021-03-30 · Jiahao Lu, Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by speci…

Generative Adversarial NetworkImage RegistrationImage-to-Image TranslationRepresentation Learning+1

Can representation learning for multimodal image registration be improved by supervision of intermediate layers?

2023-03-01 · Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje

Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a m…

Contrastive Learningimage-classificationImage ClassificationImage Registration+2

Real-time multimodal image registration with partial intraoperative point-set data

2021-09-10 · Zachary M C Baum, Yipeng Hu, Dean C Barratt

We present Free Point Transformer (FPT) - a deep neural network architecture for non-rigid point-set registration. Consisting of two modules, a global feature extraction module and a point transformation module, FPT does…

Image Registration

Coarse to fine non-rigid registration: a chain of scale-specific neural networks for multimodal image alignment with application to remote sensing

2018-02-27 · Armand Zampieri, Guillaume Charpiat, Yuliya Tarabalka

We tackle here the problem of multimodal image non-rigid registration, which is of prime importance in remote sensing and medical imaging. The difficulties encountered by classical registration approaches include feature…