3-D PET Image Generation with tumour masks using TGAN
Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3-D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PET images. We also show that by conditioning the generator on tumour masks, we are able to control the geometry and location of the tumour in the generated images. To test the utility of the synthetic images, we train a segmentation model using the synthetic images. Synthetic images conditioned on real tumour masks are automatically segmented, and the corresponding real images are also segmented. We evaluate the segmentations using the Dice score and find the segmentation algorithm performs similarly on both datasets (0.65 synthetic data, 0.70 real data). Various radionomic features are then calculated over the segmented tumour volumes for each data set. A comparison of the real and synthetic feature distributions show that seven of eight feature distributions had statistically insignificant differences (p>0.05). Correlation coefficients were also calculated between all radionomic features and it is shown that all of the strong statistical correlations in the real data set are preserved in the synthetic data set.
Code (1)
Tasks
Image GenerationImage SegmentationSegmentationSemantic SegmentationVideo GenerationSimilar Papers 제목 키워드 기반
maskSLIC: Regional Superpixel Generation with Application to Local Pathology Characterisation in Medical Images
Supervoxel methods such as Simple Linear Iterative Clustering (SLIC) are an effective technique for partitioning an image or volume into locally similar regions, and are a common building block for the development of det…
ClusteringImage Synthesis From Layout With Locality-Aware Mask Adaption
This paper is concerned with synthesizing images conditioned on a layout (a set of bounding boxes with object categories). Existing works construct a layout-mask-image pipeline. Object masks are generated separately …
Image GenerationObjectSemantic SegmentationMETGAN: Generative Tumour Inpainting and Modality Synthesis in Light Sheet Microscopy
Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such da…
SegmentationEditGAN: High-Precision Semantic Image Editing
Generative adversarial networks (GANs) have recently found applications in image editing. However, most GAN based image editing methods often require large scale datasets with semantic segmentation annotations for traini…
SegmentationSemantic SegmentationVocal Bursts Intensity PredictionFTGAN: A Fully-trained Generative Adversarial Networks for Text to Face Generation
As a sub-domain of text-to-image synthesis, text-to-face generation has huge potentials in public safety domain. With lack of dataset, there are almost no related research focusing on text-to-face synthesis. In this pape…
DecoderFace GenerationGenerative Adversarial NetworkImage Generation+1