Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data
Multi-centre colonoscopy images from various medical centres exhibit distinct complicating factors and overlays that impact the image content, contingent on the specific acquisition centre. Existing Deep Segmentation networks struggle to achieve adequate generalizability in such data sets, and the currently available data augmentation methods do not effectively address these sources of data variability. As a solution, we introduce an innovative data augmentation approach centred on interpretability saliency maps, aimed at enhancing the generalizability of Deep Learning models within the realm of multi-centre colonoscopy image segmentation. The proposed augmentation technique demonstrates increased robustness across different segmentation models and domains. Thorough testing on a publicly available multi-centre dataset for polyp detection demonstrates the effectiveness and versatility of our approach, which is observed both in quantitative and qualitative results. The code is publicly available at: https://github.com/nki-radiology/interpretability_augmentation
Code (1)
Tasks
Data AugmentationImage SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
On the Impact of Interpretability Methods in Active Image Augmentation Method
Robustness is a significant constraint in machine learning models. The performance of the algorithms must not deteriorate when training and testing with slightly different data. Deep neural network models achieve awe-ins…
Image AugmentationGUNNEL: Guided Mixup Augmentation and Multi-View Fusion for Aquatic Animal Segmentation
Recent years have witnessed great advances in object segmentation research. In addition to generic objects, aquatic animals have attracted research attention. Deep learning-based methods are widely used for aquatic anima…
BenchmarkingInstance SegmentationSegmentationSemantic SegmentationLMSeg: Language-guided Multi-dataset Segmentation
It's a meaningful and attractive topic to build a general and inclusive segmentation model that can recognize more categories in various scenarios. A straightforward way is to combine the existing fragmented segmentation…
Image AugmentationPanoptic SegmentationSegmentationLess is More: Unsupervised Mask-guided Annotated CT Image Synthesis with Minimum Manual Segmentations
As a pragmatic data augmentation tool, data synthesis has generally returned dividends in performance for deep learning based medical image analysis. However, generating corresponding segmentation masks for synthetic med…
Data AugmentationImage GenerationMedical Image AnalysisSegmentationA Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation
Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image s…
Medical Image SegmentationData Augmentation