paper-with-me

Papers

DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort

2021-04-13 · CVPR 2021 1 · Yuxuan Zhang, Huan Ling, Jun Gao, Kangxue Yin, Jean-Francois Lafleche, Adela Barriuso, Antonio Torralba, Sanja Fidler

We introduce DatasetGAN: an automatic procedure to generate massive datasets of high-quality semantically segmented images requiring minimal human effort. Current deep networks are extremely data-hungry, benefiting from training on large-scale datasets, which are time consuming to annotate. Our method relies on the power of recent GANs to generate realistic images. We show how the GAN latent code can be decoded to produce a semantic segmentation of the image. Training the decoder only needs a few labeled examples to generalize to the rest of the latent space, resulting in an infinite annotated dataset generator! These generated datasets can then be used for training any computer vision architecture just as real datasets are. As only a few images need to be manually segmented, it becomes possible to annotate images in extreme detail and generate datasets with rich object and part segmentations. To showcase the power of our approach, we generated datasets for 7 image segmentation tasks which include pixel-level labels for 34 human face parts, and 32 car parts. Our approach outperforms all semi-supervised baselines significantly and is on par with fully supervised methods, which in some cases require as much as 100x more annotated data as our method.

📄 PDF Abstract BibTeX arXiv:2104.06490

Code (2)

nv-tlabs/datasetGAN_release 공식 구현 pytorch
Mind23-2/MindCode-124

Tasks

DecoderImage SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations

2022-01-12 · CVPR 2022 1 · Daiqing Li, Huan Ling, Seung Wook Kim, Karsten Kreis 외

Annotating images with pixel-wise labels is a time-consuming and costly process. Recently, DatasetGAN showcased a promising alternative - to synthesize a large labeled dataset via a generative adversarial network (GAN) b…

8kGenerative Adversarial NetworkSegmentation

RadImageGAN -- A Multi-modal Dataset-Scale Generative AI for Medical Imaging

2023-12-10 · Zelong Liu, Alexander Zhou, Arnold Yang, Alara Yilmaz 외

Deep learning in medical imaging often requires large-scale, high-quality data or initiation with suitably pre-trained weights. However, medical datasets are limited by data availability, domain-specific knowledge, and p…

Segmentation

Application of DatasetGAN in medical imaging: preliminary studies

2022-02-27 · Zong Fan, Varun Kelkar, Mark A. Anastasio, Hua Li

Generative adversarial networks (GANs) have been widely investigated for many potential applications in medical imaging. DatasetGAN is a recently proposed framework based on modern GANs that can synthesize high-quality s…

Image SegmentationSegmentationSemantic Segmentation

Histopathology DatasetGAN: Synthesizing Large-Resolution Histopathology Datasets

2022-07-06 · S. A. Rizvi, P. Cicalese, S. V. Seshan, S. Sciascia 외

Self-supervised learning (SSL) methods are enabling an increasing number of deep learning models to be trained on image datasets in domains where labels are difficult to obtain. These methods, however, struggle to scale …

Image GenerationSelf-Supervised Learning

DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields

2023-11-18 · Yu Chi, Fangneng Zhan, Sibo Wu, Christian Theobalt 외

Progress in 3D computer vision tasks demands a huge amount of data, yet annotating multi-view images with 3D-consistent annotations, or point clouds with part segmentation is both time-consuming and challenging. This pap…

DecoderPoint Cloud SegmentationSegmentationVideo Segmentation+1