Cooperative Training and Latent Space Data Augmentation for Robust Medical Image Segmentation
Deep learning-based segmentation methods are vulnerable to unforeseen data distribution shifts during deployment, e.g. change of image appearances or contrasts caused by different scanners, unexpected imaging artifacts etc. In this paper, we present a cooperative framework for training image segmentation models and a latent space augmentation method for generating hard examples. Both contributions improve model generalization and robustness with limited data. The cooperative training framework consists of a fast-thinking network (FTN) and a slow-thinking network (STN). The FTN learns decoupled image features and shape features for image reconstruction and segmentation tasks. The STN learns shape priors for segmentation correction and refinement. The two networks are trained in a cooperative manner. The latent space augmentation generates challenging examples for training by masking the decoupled latent space in both channel-wise and spatial-wise manners. We performed extensive experiments on public cardiac imaging datasets. Using only 10 subjects from a single site for training, we demonstrated improved cross-site segmentation performance and increased robustness against various unforeseen imaging artifacts compared to strong baseline methods. Particularly, cooperative training with latent space data augmentation yields 15% improvement in terms of average Dice score when compared to a standard training method.
Code (2)
Tasks
Data AugmentationImage ReconstructionImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Towards Composable Distributions of Latent Space Augmentations
We propose a composable framework for latent space image augmentation that allows for easy combination of multiple augmentations. Image augmentation has been shown to be an effective technique for improving the performan…
Image Augmentationimage-classificationImage ClassificationMODALS: Modality-agnostic Automated Data Augmentation in the Latent Space
Data augmentation is an efficient way to expand a training dataset by creating additional artificial data. While data augmentation is found to be effective in improving the generalization capability of models for various…
Data AugmentationTime SeriesTime Series AnalysisSo Different Yet So Alike! Constrained Unsupervised Text Style Transfer
Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target domain. However, it does not explicitly ma…
AttributeData AugmentationGenerative Adversarial NetworkStyle Transfer+2Latent Filling: Latent Space Data Augmentation for Zero-shot Speech Synthesis
Previous works in zero-shot text-to-speech (ZS-TTS) have attempted to enhance its systems by enlarging the training data through crowd-sourcing or augmenting existing speech data. However, the use of low-quality data has…
Data AugmentationSpeech Synthesistext-to-speechText to SpeechGraphMAD: Graph Mixup for Data Augmentation using Data-Driven Convex Clustering
We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training dat…
ClusteringData AugmentationGraph Classification