Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images
Deep learning-based medical image registration and segmentation joint models utilize the complementarity (augmentation data or weakly supervised data from registration, region constraints from segmentation) to bring mutual improvement in complex scene and few-shot situation. However, further adoption of the joint models are hindered: 1) the diversity of augmentation data is reduced limiting the further enhancement of segmentation, 2) misaligned regions in weakly supervised data disturb the training process, 3) lack of label-based region constraints in few-shot situation limits the registration performance. We propose a novel Deep Complementary Joint Model (DeepRS) for complex scene registration and few-shot segmentation. We embed a perturbation factor in the registration to increase the activity of deformation thus maintaining the augmentation data diversity. We take a pixel-wise discriminator to extract alignment confidence maps which highlight aligned regions in weakly supervised data so the misaligned regions' disturbance will be suppressed via weighting. The outputs from segmentation model are utilized to implement deep-based region constraints thus relieving the label requirements and bringing fine registration. Extensive experiments on the CT dataset of MM-WHS 2017 Challenge show great advantages of our DeepRS that outperforms the existing state-of-the-art models.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityImage RegistrationMedical Image RegistrationSegmentationSimilar Papers 제목 키워드 기반
Learning 3D-3D Correspondences for One-shot Partial-to-partial Registration
While 3D-3D registration is traditionally tacked by optimization-based methods, recent work has shown that learning-based techniques could achieve faster and more robust results. In this context, however, only PRNet can …
Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration
The filming of sporting events projects and flattens the movement of athletes in the world onto a 2D broadcast image. The pixel locations of joints in these images can be detected with high validity. Recovering the actua…
2D Human Pose Estimation3D Human Pose Estimation3D Pose EstimationCamera Calibration+3UniRiT: Towards Few-Shot Non-Rigid Point Cloud Registration
Non-rigid point cloud registration is a critical challenge in 3D scene understanding, particularly in surgical navigation. Although existing methods achieve excellent performance when trained on large-scale, high-quality…
Point Cloud RegistrationRepresentation LearningScene UnderstandingZeroReg: Zero-Shot Point Cloud Registration with Foundation Models
State-of-the-art 3D point cloud registration methods rely on labeled 3D datasets for training, which limits their practical applications in real-world scenarios and often hinders generalization to unseen scenes. Leveragi…
DecoderGraph MatchingObjectObject Localization+1YOWO: You Only Walk Once to Jointly Map An Indoor Scene and Register Ceiling-mounted Cameras
Using ceiling-mounted cameras (CMCs) for indoor visual capturing opens up a wide range of applications. However , registering CMCs to the target scene layout presents a challenging task. While manual registration with sp…
Visual Localization