paper-with-me

Papers

Real-time multimodal image registration with partial intraoperative point-set data

2021-09-10 · Zachary M C Baum, Yipeng Hu, Dean C Barratt

We present Free Point Transformer (FPT) - a deep neural network architecture for non-rigid point-set registration. Consisting of two modules, a global feature extraction module and a point transformation module, FPT does not assume explicit constraints based on point vicinity, thereby overcoming a common requirement of previous learning-based point-set registration methods. FPT is designed to accept unordered and unstructured point-sets with a variable number of points and uses a "model-free" approach without heuristic constraints. Training FPT is flexible and involves minimizing an intuitive unsupervised loss function, but supervised, semi-supervised, and partially- or weakly-supervised training are also supported. This flexibility makes FPT amenable to multimodal image registration problems where the ground-truth deformations are difficult or impossible to measure. In this paper, we demonstrate the application of FPT to non-rigid registration of prostate magnetic resonance (MR) imaging and sparsely-sampled transrectal ultrasound (TRUS) images. The registration errors were 4.71 mm and 4.81 mm for complete TRUS imaging and sparsely-sampled TRUS imaging, respectively. The results indicate superior accuracy to the alternative rigid and non-rigid registration algorithms tested and substantially lower computation time. The rapid inference possible with FPT makes it particularly suitable for applications where real-time registration is beneficial.

📄 PDF Abstract BibTeX arXiv:2109.05023

Code (0)

등록된 구현이 없습니다.

Tasks

Image Registration

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Can representation learning for multimodal image registration be improved by supervision of intermediate layers?

2023-03-01 · Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje

Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a m…

Contrastive Learningimage-classificationImage ClassificationImage Registration+2

A Low-Dimensional Step Pattern Analysis Algorithm With Application to Multimodal Retinal Image Registration

2015-06-01 · CVPR 2015 6 · Jimmy Addison Lee, Jun Cheng, Beng Hai Lee, Ee Ping Ong 외

Existing feature descriptor-based methods on retinal image registration are mainly based on scale-invariant feature transform (SIFT) or partial intensity invariant feature descriptor (PIIFD). While these descriptors are …

Image Registration

Generation of annotated multimodal ground truth datasets for abdominal medical image registration

2020-12-02 · Dominik F. Bauer, Tom Russ, Barbara I. Waldkirch, Christian Tönnes 외

Sparsity of annotated data is a major limitation in medical image processing tasks such as registration. Registered multimodal image data are essential for the diagnosis of medical conditions and the success of intervent…

Computed Tomography (CT)Image RegistrationImage SegmentationMedical Image Registration+1

Multimodal Remote Sensing Image Registration Based on Adaptive Multi-scale PIIFD

2022-11-09 · Ning li, YuXuan Li, Jichao Jiao

In recent years, due to the wide application of multi-sensor vision systems, multimodal image acquisition technology has continued to develop, and the registration problem based on multimodal images has gradually emerged…

Image Registration

Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Images

2026-01-16 · Xiaofan Wang, Junyi Wang, Yuqian Chen, Lauren J. O' Donnell 외 arxiv

Multimodal image registration between diffusion MRI (dMRI) and T1-weighted (T1w) MRI images is a critical step for aligning diffusion-weighted imaging (DWI) data with structural anatomical space. Traditional registration…

Image Registration