Data Instance Prior for Transfer Learning in GANs
Recent advances in generative adversarial networks (GANs) have shown remarkable progress in generating high-quality images. However, this gain in performance depends on the availability of a large amount of training data. In limited data regimes, training typically diverges, and therefore the generated samples are of low quality and lack diversity. Previous works have addressed training in low data setting by leveraging transfer learning and data augmentation techniques. We propose a novel transfer learning method for GANs in the limited data domain by leveraging informative data prior derived from self-supervised/supervised pre-trained networks trained on a diverse source domain. We perform experiments on several standard vision datasets using various GAN architectures (BigGAN, SNGAN, StyleGAN2) to demonstrate that the proposed method effectively transfers knowledge to domains with few target images, outperforming existing state-of-the-art techniques in terms of image quality and diversity. We also show the utility of data instance prior in large-scale unconditional image generation and image editing tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityImage GenerationTransfer LearningUnconditional Image GenerationSimilar Papers 제목 키워드 기반
Data InStance Prior (DISP) in Generative Adversarial Networks
Recent advances in generative adversarial networks (GANs) have shown remarkable progress in generating high-quality images. However, this gain in performance depends on the availability of a large amount of training data…
Data AugmentationDiversityImage GenerationTransfer Learning+1P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection
One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are…
Anomaly DetectionDecoderKnowledge DistillationNovelty Detection+1Looks Like Magic: Transfer Learning in GANs to Generate New Card Illustrations
In this paper, we propose MAGICSTYLEGAN and MAGICSTYLEGAN-ADA - both incarnations of the state-of-the-art models StyleGan2 and StyleGan2 ADA - to experiment with their capacity of transfer learning into a rather differen…
Transfer LearningCommonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data
Transfer learning for GANs successfully improves generation performance under low-shot regimes. However, existing studies show that the pretrained model using a single benchmark dataset is not generalized to various targ…
Inference AttackMembership Inference AttackTransfer LearningDo MIL Models Transfer?
Multiple Instance Learning (MIL) is a cornerstone approach in computational pathology (CPath) for generating clinically meaningful slide-level embeddings from gigapixel tissue images. However, MIL often struggles with sm…
Multiple Instance LearningTransfer Learning