Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction
Shortage of fully annotated datasets has been a limiting factor in developing deep learning based image segmentation algorithms and the problem becomes more pronounced in multi-organ segmentation. In this paper, we propose a unified training strategy that enables a novel multi-scale deep neural network to be trained on multiple partially labeled datasets for multi-organ segmentation. In addition, a new network architecture for multi-scale feature abstraction is proposed to integrate pyramid input and feature analysis into a U-shape pyramid structure. To bridge the semantic gap caused by directly merging features from different scales, an equal convolutional depth mechanism is introduced. Furthermore, we employ a deep supervision mechanism to refine the outputs in different scales. To fully leverage the segmentation features from all the scales, we design an adaptive weighting layer to fuse the outputs in an automatic fashion. All these mechanisms together are integrated into a Pyramid Input Pyramid Output Feature Abstraction Network (PIPO-FAN). Our proposed method was evaluated on four publicly available datasets, including BTCV, LiTS, KiTS and Spleen, where very promising performance has been achieved. The source code of this work is publicly shared at https://github.com/DIAL-RPI/PIPO-FAN for others to easily reproduce the work and build their own models with the introduced mechanisms.
Code (1)
Tasks
Image SegmentationOrgan SegmentationPartially Labeled DatasetsSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation
The task of labeling multiple organs for segmentation is a complex and time-consuming process, resulting in a scarcity of comprehensively labeled multi-organ datasets while the emergence of numerous partially labeled dat…
Organ SegmentationPartially Labeled DatasetsSegmentationFoundation Model-guided Iteratively Prompting and Pseudo-Labeling for Partially Labeled Medical Image Segmentation
Automated medical image segmentation has achieved remarkable progress with fully labeled data. However, site-specific clinical priorities and the high cost of manual annotation often yield scans with only a subset of org…
Medical Image SegmentationMarginal loss and exclusion loss for partially supervised multi-organ segmentation
Annotating multiple organs in medical images is both costly and time-consuming; therefore, existing multi-organ datasets with labels are often low in sample size and mostly partially labeled, that is, a dataset has a few…
Organ SegmentationSegmentationLearning from partially labeled data for multi-organ and tumor segmentation
Medical image benchmarks for the segmentation of organs and tumors suffer from the partially labeling issue due to its intensive cost of labor and expertise. Current mainstream approaches follow the practice of one netwo…
Image SegmentationMedical Image SegmentationPartially Labeled DatasetsSegmentation+3DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets
Due to the intensive cost of labor and expertise in annotating 3D medical images at a voxel level, most benchmark datasets are equipped with the annotations of only one type of organs and/or tumors, resulting in the so-c…
Image SegmentationMedical Image SegmentationOrgan SegmentationPartially Labeled Datasets+3