paper-with-me

홈 › Papers

On Leveraging Pretrained GANs for Generation with Limited Data

2020-02-26 · ICML 2020 1 · Miaoyun Zhao, Yulai Cong, Lawrence Carin

Recent work has shown generative adversarial networks (GANs) can generate highly realistic images, that are often indistinguishable (by humans) from real images. Most images so generated are not contained in the training dataset, suggesting potential for augmenting training sets with GAN-generated data. While this scenario is of particular relevance when there are limited data available, there is still the issue of training the GAN itself based on that limited data. To facilitate this, we leverage existing GAN models pretrained on large-scale datasets (like ImageNet) to introduce additional knowledge (which may not exist within the limited data), following the concept of transfer learning. Demonstrated by natural-image generation, we reveal that low-level filters (those close to observations) of both the generator and discriminator of pretrained GANs can be transferred to facilitate generation in a perceptually-distinct target domain with limited training data. To further adapt the transferred filters to the target domain, we propose adaptive filter modulation (AdaFM). An extensive set of experiments is presented to demonstrate the effectiveness of the proposed techniques on generation with limited data.

📄 PDF Abstract BibTeX arXiv:2002.11810

Code (1)

MiaoyunZhao/GANTransferLimitedData 공식 구현 pytorch

Tasks

Image GenerationTransfer Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Transferring GANs: generating images from limited data

2018-05-04 · ECCV 2018 9 · Yaxing Wang, Chenshen Wu, Luis Herranz, Joost Van de Weijer 외

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been s…

10-shot image generationDiversityDomain AdaptationImage Generation

Transferring Unconditional to Conditional GANs with Hyper-Modulation

2021-12-04 · Héctor Laria, Yaxing Wang, Joost Van de Weijer, Bogdan Raducanu

GANs have matured in recent years and are able to generate high-resolution, realistic images. However, the computational resources and the data required for the training of high-quality GANs are enormous, and the study o…

Conditional Image GenerationContrastive LearningTransfer Learning

A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration

2022-07-21 · Ming Liu, Yuxiang Wei, Xiaohe Wu, WangMeng Zuo 외

Generative adversarial networks (GANs) have drawn enormous attention due to the simple yet effective training mechanism and superior image generation quality. With the ability to generate photo-realistic high-resolution …

Image GenerationImage Restoration

Diverse Rare Sample Generation with Pretrained GANs

2024-12-27 · SuBeen Lee, Jiyeon Han, Soyeon Kim, Jaesik Choi

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent me…

Density EstimationDiversity

End-to-End Differentiable GANs for Text Generation

2020-10-19 · NeurIPS Workshop ICBINB 2020 12 · Sachin Kumar, Yulia Tsvetkov

Despite being widely used, text generation models trained with maximum likelihood estimation (MLE) suffer from known limitations. Due to a mismatch between training and inference, they suffer from exposure bias. Generat…

Text Generation