paper-with-me

홈 › Papers

3-D PET Image Generation with tumour masks using TGAN

2021-11-02 · Robert V Bergen, Jean-Francois Rajotte, Fereshteh Yousefirizi, Ivan S Klyuzhin, Arman Rahmim, Raymond T. Ng

Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3-D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PET images. We also show that by conditioning the generator on tumour masks, we are able to control the geometry and location of the tumour in the generated images. To test the utility of the synthetic images, we train a segmentation model using the synthetic images. Synthetic images conditioned on real tumour masks are automatically segmented, and the corresponding real images are also segmented. We evaluate the segmentations using the Dice score and find the segmentation algorithm performs similarly on both datasets (0.65 synthetic data, 0.70 real data). Various radionomic features are then calculated over the segmented tumour volumes for each data set. A comparison of the real and synthetic feature distributions show that seven of eight feature distributions had statistically insignificant differences (p>0.05). Correlation coefficients were also calculated between all radionomic features and it is shown that all of the strong statistical correlations in the real data set are preserved in the synthetic data set.

📄 PDF Abstract BibTeX arXiv:2111.01866

Code (1)

robbergen/trgan

Tasks

Image GenerationImage SegmentationSegmentationSemantic SegmentationVideo Generation

Similar Papers 제목 키워드 기반

maskSLIC: Regional Superpixel Generation with Application to Local Pathology Characterisation in Medical Images

2016-06-30 · Benjamin Irving

Supervoxel methods such as Simple Linear Iterative Clustering (SLIC) are an effective technique for partitioning an image or volume into locally similar regions, and are a common building block for the development of det…

Clustering

Image Synthesis From Layout With Locality-Aware Mask Adaption

2021-01-01 · ICCV 2021 10 · Zejian Li, Jingyu Wu, Immanuel Koh, Yongchuan Tang 외

This paper is concerned with synthesizing images conditioned on a layout (a set of bounding boxes with object categories). Existing works construct a layout-mask-image pipeline. Object masks are generated separately …

Image GenerationObjectSemantic Segmentation

METGAN: Generative Tumour Inpainting and Modality Synthesis in Light Sheet Microscopy

2021-04-22 · Izabela Horvath, Johannes C. Paetzold, Oliver Schoppe, Rami Al-Maskari 외

Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such da…

Segmentation

EditGAN: High-Precision Semantic Image Editing

2021-11-04 · NeurIPS 2021 12 · Huan Ling, Karsten Kreis, Daiqing Li, Seung Wook Kim 외

Generative adversarial networks (GANs) have recently found applications in image editing. However, most GAN based image editing methods often require large scale datasets with semantic segmentation annotations for traini…

SegmentationSemantic SegmentationVocal Bursts Intensity Prediction

FTGAN: A Fully-trained Generative Adversarial Networks for Text to Face Generation

2019-04-11 · Xiang Chen, Lingbo Qing, Xiaohai He, Xiaodong Luo 외

As a sub-domain of text-to-image synthesis, text-to-face generation has huge potentials in public safety domain. With lack of dataset, there are almost no related research focusing on text-to-face synthesis. In this pape…

DecoderFace GenerationGenerative Adversarial NetworkImage Generation+1