Learning Generalized Non-Rigid Multimodal Biomedical Image Registration from Generic Point Set Data
Free Point Transformer (FPT) has been proposed as a data-driven, non-rigid point set registration approach using deep neural networks. As FPT does not assume constraints based on point vicinity or correspondence, it may be trained simply and in a flexible manner by minimizing an unsupervised loss based on the Chamfer Distance. This makes FPT amenable to real-world medical imaging applications where ground-truth deformations may be infeasible to obtain, or in scenarios where only a varying degree of completeness in the point sets to be aligned is available. To test the limit of the correspondence finding ability of FPT and its dependency on training data sets, this work explores the generalizability of the FPT from well-curated non-medical data sets to medical imaging data sets. First, we train FPT on the ModelNet40 dataset to demonstrate its effectiveness and the superior registration performance of FPT over iterative and learning-based point set registration methods. Second, we demonstrate superior performance in rigid and non-rigid registration and robustness to missing data. Last, we highlight the interesting generalizability of the ModelNet-trained FPT by registering reconstructed freehand ultrasound scans of the spine and generic spine models without additional training, whereby the average difference to the ground truth curvatures is 1.3 degrees, across 13 patients.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multimodality Biomedical Image Registration using Free Point Transformer Networks
We describe a point-set registration algorithm based on a novel free point transformer (FPT) network, designed for points extracted from multimodal biomedical images for registration tasks, such as those frequently encou…
Image RegistrationIs Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study
Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by speci…
Generative Adversarial NetworkImage RegistrationImage-to-Image TranslationRepresentation Learning+1Can representation learning for multimodal image registration be improved by supervision of intermediate layers?
Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a m…
Contrastive Learningimage-classificationImage ClassificationImage Registration+2Real-time multimodal image registration with partial intraoperative point-set data
We present Free Point Transformer (FPT) - a deep neural network architecture for non-rigid point-set registration. Consisting of two modules, a global feature extraction module and a point transformation module, FPT does…
Image RegistrationCoarse to fine non-rigid registration: a chain of scale-specific neural networks for multimodal image alignment with application to remote sensing
We tackle here the problem of multimodal image non-rigid registration, which is of prime importance in remote sensing and medical imaging. The difficulties encountered by classical registration approaches include feature…