Boosting Medical Image Synthesis via Registration-guided Consistency and Disentanglement Learning
Medical image synthesis remains challenging due to misalignment noise during training. Existing methods have attempted to address this challenge by incorporating a registration-guided module. However, these methods tend to overlook the task-specific constraints on the synthetic and registration modules, which may cause the synthetic module to still generate spatially aligned images with misaligned target images during training, regardless of the registration module's function. Therefore, this paper proposes registration-guided consistency and incorporates disentanglement learning for medical image synthesis. The proposed registration-guided consistency architecture fosters task-specificity within the synthetic and registration modules by applying identical deformation fields before and after synthesis, while enforcing output consistency through an alignment loss. Moreover, the synthetic module is designed to possess the capability of disentangling anatomical structures and specific styles across various modalities. An anatomy consistency loss is introduced to further compel the synthetic module to preserve geometrical integrity within latent spaces. Experiments conducted on both an in-house abdominal CECT-CT dataset and a publicly available pelvic MR-CT dataset have demonstrated the superiority of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyDisentanglementImage GenerationSpecificitySimilar Papers 제목 키워드 기반
Attention-Driven Framework for Non-Rigid Medical Image Registration
Deformable medical image registration is a fundamental task in medical image analysis with applications in disease diagnosis, treatment planning, and image-guided interventions. Despite significant advances in deep learn…
Medical Image RegistrationComputational EfficiencySAM-Guided Robust Representation Learning for One-Shot 3D Medical Image Segmentation
One-shot medical image segmentation (MIS) is crucial for medical analysis due to the burden of medical experts on manual annotation. The recent emergence of the segment anything model (SAM) has demonstrated remarkable ad…
General KnowledgeImage SegmentationKnowledge DistillationMedical Image Segmentation+3Deep Learning-based Point Cloud Registration for Augmented Reality-guided Surgery
Point cloud registration aligns 3D point clouds using spatial transformations. It is an important task in computer vision, with applications in areas such as augmented reality (AR) and medical imaging. This work explores…
Deep LearningPoint Cloud RegistrationDeep learning in medical image registration: introduction and survey
Image registration (IR) is a process that deforms images to align them with respect to a reference space, making it easier for medical practitioners to examine various medical images in a standardized reference frame, su…
Deep LearningImage RegistrationMedical Image RegistrationSurveyJSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans
Multi-modal image registration is a challenging problem yet important clinical task in many real applications and scenarios. For medical imaging based diagnosis, deformable registration among different image modalities i…
Image RegistrationMulti-Task LearningSegmentationSemantic Segmentation