Universal Lesion Detection by Learning from Multiple Heterogeneously Labeled Datasets
Lesion detection is an important problem within medical imaging analysis. Most previous work focuses on detecting and segmenting a specialized category of lesions (e.g., lung nodules). However, in clinical practice, radiologists are responsible for finding all possible types of anomalies. The task of universal lesion detection (ULD) was proposed to address this challenge by detecting a large variety of lesions from the whole body. There are multiple heterogeneously labeled datasets with varying label completeness: DeepLesion, the largest dataset of 32,735 annotated lesions of various types, but with even more missing annotation instances; and several fully-labeled single-type lesion datasets, such as LUNA for lung nodules and LiTS for liver tumors. In this work, we propose a novel framework to leverage all these datasets together to improve the performance of ULD. First, we learn a multi-head multi-task lesion detector using all datasets and generate lesion proposals on DeepLesion. Second, missing annotations in DeepLesion are retrieved by a new method of embedding matching that exploits clinical prior knowledge. Last, we discover suspicious but unannotated lesions using knowledge transfer from single-type lesion detectors. In this way, reliable positive and negative regions are obtained from partially-labeled and unlabeled images, which are effectively utilized to train ULD. To assess the clinically realistic protocol of 3D volumetric ULD, we fully annotated 1071 CT sub-volumes in DeepLesion. Our method outperforms the current state-of-the-art approach by 29% in the metric of average sensitivity.
Code (0)
등록된 구현이 없습니다.
Tasks
Lesion DetectionMedical Object DetectionTransfer LearningSimilar Papers 제목 키워드 기반
Learning from Multiple Datasets with Heterogeneous and Partial Labels for Universal Lesion Detection in CT
Large-scale datasets with high-quality labels are desired for training accurate deep learning models. However, due to the annotation cost, datasets in medical imaging are often either partially-labeled or small. For exam…
Lesion DetectionPartially Labeled DatasetsTransfer LearningAn End-to-End Framework For Universal Lesion Detection With Missing Annotations
Fully annotated large-scale medical image datasets are highly valuable. However, because labeling medical images is tedious and requires specialized knowledge, the large-scale datasets available often have missing annota…
Lesion DetectionRevisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices
Universal lesion detection from computed tomography (CT) slices is important for comprehensive disease screening. Since each lesion can locate in multiple adjacent slices, 3D context modeling is of great significance for…
2D Object DetectionComputed Tomography (CT)Lesion DetectionMedical Image Analysis+3Methods for the frugal labeler: Multi-class semantic segmentation on heterogeneous labels
Deep learning increasingly accelerates biomedical research, deploying neural networks for multiple tasks, such as image classification, object detection, and semantic segmentation. However, neural networks are commonly t…
2D Semantic Segmentationimage-classificationImage Classificationobject-detection+4DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detection
Incorporating data-specific domain knowledge in deep networks explicitly can provide important cues beneficial for lesion detection and can mitigate the need for diverse heterogeneous datasets for learning robust detecto…
Computed Tomography (CT)Lesion DetectionMedical Object DetectionRegion Proposal