Self-Supervised GANs via Auxiliary Rotation Loss
Conditional GANs are at the forefront of natural image synthesis. The main drawback of such models is the necessity for labeled data. In this work we exploit two popular unsupervised learning techniques, adversarial training and self-supervision, and take a step towards bridging the gap between conditional and unconditional GANs. In particular, we allow the networks to collaborate on the task of representation learning, while being adversarial with respect to the classic GAN game. The role of self-supervision is to encourage the discriminator to learn meaningful feature representations which are not forgotten during training. We test empirically both the quality of the learned image representations, and the quality of the synthesized images. Under the same conditions, the self-supervised GAN attains a similar performance to state-of-the-art conditional counterparts. Finally, we show that this approach to fully unsupervised learning can be scaled to attain an FID of 23.4 on unconditional ImageNet generation.
Code (4)
Tasks
Image GenerationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exploring DeshuffleGANs in Self-Supervised Generative Adversarial Networks
Generative Adversarial Networks (GANs) have become the most used networks towards solving the problem of image generation. Self-supervised GANs are later proposed to avoid the catastrophic forgetting of the discriminator…
Image GenerationMatchGAN: A Self-Supervised Semi-Supervised Conditional Generative Adversarial Network
We present a novel self-supervised learning approach for conditional generative adversarial networks (GANs) under a semi-supervised setting. Unlike prior self-supervised approaches which often involve geometric augmentat…
AttributeGenerative Adversarial NetworkSelf-Supervised LearningFedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine Transform Loss
The existence of completely aligned and paired multi-modal neuroimaging data has proved its effectiveness in the diagnosis of brain diseases. However, collecting the full set of well-aligned and paired data is impractica…
Data AugmentationImage GenerationSelf-Supervised LearningUnsupervised Deep Metric Learning via Auxiliary Rotation Loss
Deep metric learning is an important area due to its applicability to many domains such as image retrieval and person re-identification. The main drawback of such models is the necessity for labeled data. In this work, w…
ClusteringImage RetrievalMetric LearningPerson Re-Identification+1Tailoring Self-Supervision for Supervised Learning
Recently, it is shown that deploying a proper self-supervision is a prospective way to enhance the performance of supervised learning. Yet, the benefits of self-supervision are not fully exploited as previous pretext tas…
Adversarial RobustnessData AugmentationImage Classificationimbalanced classification+2