paper-with-me

홈 › Papers

Improving CT Image Segmentation Accuracy Using StyleGAN Driven Data Augmentation

2023-02-07 · Soham Bhosale, Arjun Krishna, Ge Wang, Klaus Mueller

Medical Image Segmentation is a useful application for medical image analysis including detecting diseases and abnormalities in imaging modalities such as MRI, CT etc. Deep learning has proven to be promising for this task but usually has a low accuracy because of the lack of appropriate publicly available annotated or segmented medical datasets. In addition, the datasets that are available may have a different texture because of different dosage values or scanner properties than the images that need to be segmented. This paper presents a StyleGAN-driven approach for segmenting publicly available large medical datasets by using readily available extremely small annotated datasets in similar modalities. The approach involves augmenting the small segmented dataset and eliminating texture differences between the two datasets. The dataset is augmented by being passed through six different StyleGANs that are trained on six different style images taken from the large non-annotated dataset we want to segment. Specifically, style transfer is used to augment the training dataset. The annotations of the training dataset are hence combined with the textures of the non-annotated dataset to generate new anatomically sound images. The augmented dataset is then used to train a U-Net segmentation network which displays a significant improvement in the segmentation accuracy in segmenting the large non-annotated dataset.

📄 PDF Abstract BibTeX arXiv:2302.03285

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationImage SegmentationMedical Image AnalysisMedical Image SegmentationSegmentationSemantic SegmentationStyle Transfer

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery

2021-03-31 · ICCV 2021 10 · Or Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or 외

Inspired by the ability of StyleGAN to generate highly realistic images in a variety of domains, much recent work has focused on understanding how to use the latent spaces of StyleGAN to manipulate generated and real ima…

Image Manipulation

clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIP

2022-10-05 · Justin N. M. Pinkney, Chuan Li

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This …

Denoising

Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIP

2023-04-03 · Tsuyoshi Baba, Kosuke Nishida, Kyosuke Nishida

Automatic image editing has great demands because of its numerous applications, and the use of natural language instructions is essential to achieving flexible and intuitive editing as the user imagines. A pioneering wor…

Towards Arbitrary Text-driven Image Manipulation via Space Alignment

2023-01-25 · Yunpeng Bai, Zihan Zhong, Chao Dong, Weichen Zhang 외

The recent GAN inversion methods have been able to successfully invert the real image input to the corresponding editable latent code in StyleGAN. By combining with the language-vision model (CLIP), some text-driven imag…

AttributeImage Manipulation

Labels4Free: Unsupervised Segmentation using StyleGAN

2021-03-27 · ICCV 2021 10 · Rameen Abdal, Peihao Zhu, Niloy Mitra, Peter Wonka

We propose an unsupervised segmentation framework for StyleGAN generated objects. We build on two main observations. First, the features generated by StyleGAN hold valuable information that can be utilized towards traini…

Segmentation