paper-with-me

홈 › Papers

Towards Segmenting the Invisible: An End-to-End Registration and Segmentation Framework for Weakly Supervised Tumour Analysis

2026-02-05 · Budhaditya Mukhopadhyay, Chirag Mandal, Pavan Tummala, Naghmeh Mahmoodian, Andreas Nürnberger, Soumick Chatterjee arxiv

Liver tumour ablation presents a significant clinical challenge: whilst tumours are clearly visible on pre-operative MRI, they are often effectively invisible on intra-operative CT due to minimal contrast between pathological and healthy tissue. This work investigates the feasibility of cross-modality weak supervision for scenarios where pathology is visible in one modality (MRI) but absent in another (CT). We present a hybrid registration-segmentation framework that combines MSCGUNet for inter-modal image registration with a UNet-based segmentation module, enabling registration-assisted pseudo-label generation for CT images. Our evaluation on the CHAOS dataset demonstrates that the pipeline can successfully register and segment healthy liver anatomy, achieving a Dice score of 0.72. However, when applied to clinical data containing tumours, performance degrades substantially (Dice score of 0.16), revealing the fundamental limitations of current registration methods when the target pathology lacks corresponding visual features in the target modality. We analyse the "domain gap" and "feature absence" problems, demonstrating that whilst spatial propagation of labels via registration is feasible for visible structures, segmenting truly invisible pathology remains an open challenge. Our findings highlight that registration-based label transfer cannot compensate for the absence of discriminative features in the target modality, providing important insights for future research in cross-modality medical image analysis. Code an weights are available at: https://github.com/BudhaTronix/Weakly-Supervised-Tumour-Detection

📄 PDF Abstract BibTeX arXiv:2602.05453

Code (0)

등록된 구현이 없습니다.

Tasks

Image Registration

Similar Papers 제목 키워드 기반

Robustly segmenting quadriceps muscles of ultra-endurance athletes with weakly supervised U-Net

2019-08-22

In this study, segmentation of quadriceps muscle heads of ultra-endurance athletes was done using a multi-atlas segmentation and corrective leaning framework where the registration based multi-atlas segmentation step was…

Segmentation

SeGAN: Segmenting and Generating the Invisible

2017-03-29 · CVPR 2018 6 · Kiana Ehsani, Roozbeh Mottaghi, Ali Farhadi

Objects often occlude each other in scenes; Inferring their appearance beyond their visible parts plays an important role in scene understanding, depth estimation, object interaction and manipulation. In this paper, we s…

Depth EstimationScene UnderstandingSegmentation

Weakly-Supervised White and Grey Matter Segmentation in 3D Brain Ultrasound

2019-04-10 · Beatrice Demiray, Julia Rackerseder, Stevica Bozhinoski, Nassir Navab

Although the segmentation of brain structures in ultrasound helps initialize image based registration, assist brain shift compensation, and provides interventional decision support, the task of segmenting grey and white …

Transfer Learning

Weakly Supervised Registration of Prostate MRI and Histopathology Images

2021-06-23 · Wei Shao, Indrani Bhattacharya, Simon J. C. Soerensen, Christian A. Kunder 외

The interpretation of prostate MRI suffers from low agreement across radiologists due to the subtle differences between cancer and normal tissue. Image registration addresses this issue by accurately mapping the ground-t…

Image Registration

Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images

2020-08-03 · ECCV 2020 8 · Yuting He, Tiantian Li, Guanyu Yang, Youyong Kong 외

Deep learning-based medical image registration and segmentation joint models utilize the complementarity (augmentation data or weakly supervised data from registration, region constraints from segmentation) to bring mutu…

DiversityImage RegistrationMedical Image RegistrationSegmentation