Evidence fusion with contextual discounting for multi-modality medical image segmentation
As information sources are usually imperfect, it is necessary to take into account their reliability in multi-source information fusion tasks. In this paper, we propose a new deep framework allowing us to merge multi-MR image segmentation results using the formalism of Dempster-Shafer theory while taking into account the reliability of different modalities relative to different classes. The framework is composed of an encoder-decoder feature extraction module, an evidential segmentation module that computes a belief function at each voxel for each modality, and a multi-modality evidence fusion module, which assigns a vector of discount rates to each modality evidence and combines the discounted evidence using Dempster's rule. The whole framework is trained by minimizing a new loss function based on a discounted Dice index to increase segmentation accuracy and reliability. The method was evaluated on the BraTs 2021 database of 1251 patients with brain tumors. Quantitative and qualitative results show that our method outperforms the state of the art, and implements an effective new idea for merging multi-information within deep neural networks.
Code (1)
Tasks
DecoderImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Deep evidential fusion with uncertainty quantification and contextual discounting for multimodal medical image segmentation
Single-modality medical images generally do not contain enough information to reach an accurate and reliable diagnosis. For this reason, physicians generally diagnose diseases based on multimodal medical images such as, …
Image SegmentationMedical Image SegmentationSemantic SegmentationUncertainty QuantificationConservative, Proportional and Optimistic Contextual Discounting in the Belief Functions Theory
Information discounting plays an important role in the theory of belief functions and, generally, in information fusion. Nevertheless, neither classical uniform discounting nor contextual cannot model certain use cases, …
Multimodal Mixture-of-Experts with Retrieval Augmentation for Protein Active Site Identification
Accurate identification of protein active sites at the residue level is crucial for understanding protein function and advancing drug discovery. However, current methods face two critical challenges: vulnerability in sin…
Drug DiscoveryEsurvFusion: An evidential multimodal survival fusion model based on Gaussian random fuzzy numbers
Multimodal survival analysis aims to combine heterogeneous data sources (e.g., clinical, imaging, text, genomics) to improve the prediction quality of survival outcomes. However, this task is particularly challenging due…
Survival AnalysisMedical Image Segmentation with Belief Function Theory and Deep Learning
Deep learning has shown promising contributions in medical image segmentation with powerful learning and feature representation abilities. However, it has limitations for reasoning with and combining imperfect (imprecise…
Deep LearningImage SegmentationMedical Image SegmentationSegmentation+3