Learning joint lesion and tissue segmentation from task-specific hetero-modal datasets
Brain tissue segmentation from multimodal MRI is a key building block of many neuroscience analysis pipelines. It could also play an important role in many clinical imaging scenarios. Established tissue segmentation approaches have however not been developed to cope with large anatomical changes resulting from pathology. The effect of the presence of brain lesions, for example, on their performance is thus currently uncontrolled and practically unpredictable. Contrastingly, with the advent of deep neural networks (DNNs), segmentation of brain lesions has matured significantly and is achieving performance levels making it of interest for clinical use. However, few existing approaches allow for jointly segmenting normal tissue and brain lesions. Developing a DNN for such joint task is currently hampered by the fact that annotated datasets typically address only one specific task and rely on a task-specific hetero-modal imaging protocol. In this work, we propose a novel approach to build a joint tissue and lesion segmentation model from task-specific hetero-modal and partially annotated datasets. Starting from a variational formulation of the joint problem, we show how the expected risk can be decomposed and optimised empirically. We exploit an upper-bound of the risk to deal with missing imaging modalities. For each task, our approach reaches comparable performance than task-specific and fully-supervised models.
Code (0)
등록된 구현이 없습니다.
Tasks
Lesion SegmentationSegmentationSimilar Papers 제목 키워드 기반
Learning joint segmentation of tissues and brain lesions from task-specific hetero-modal domain-shifted datasets
Brain tissue segmentation from multimodal MRI is a key building block of many neuroimaging analysis pipelines. Established tissue segmentation approaches have, however, not been developed to cope with large anatomical ch…
Data AugmentationLesion SegmentationSegmentationLearning to segment anatomy and lesions from disparately labeled sources in brain MRI
Segmenting healthy tissue structures alongside lesions in brain Magnetic Resonance Images (MRI) remains a challenge for today's algorithms due to lesion-caused disruption of the anatomy and lack of jointly labeled traini…
AnatomyLesion SegmentationMeta-LearningGLI-AL: A Multi-Modal Glioma MRI Label Resource with Unified Anatomy-Lesion Labels
Existing BraTS-GLI datasets provide a widely used benchmark for adult glioma MRI segmentation, but their task definition focuses on tumor subregions and does not systematically represent coexisting white matter hyperinte…
WSI-INR: Implicit Neural Representations for Lesion Segmentation in Whole-Slide Images
Whole-slide images (WSIs) are fundamental for computational pathology, where accurate lesion segmentation is critical for clinical decision making. Existing methods partition WSIs into discrete patches, disrupting spatia…
Lesion SegmentationDecision MakingJoint Learning of Brain Lesion and Anatomy Segmentation from Heterogeneous Datasets
Brain lesion and anatomy segmentation in magnetic resonance images are fundamental tasks in neuroimaging research and clinical practice. Given enough training data, convolutional neuronal networks (CNN) proved to outperf…
AnatomyBenchmarking