Feature Statistics Mixing Regularization for Generative Adversarial Networks
In generative adversarial networks, improving discriminators is one of the key components for generation performance. As image classifiers are biased toward texture and debiasing improves accuracy, we investigate 1) if the discriminators are biased, and 2) if debiasing the discriminators will improve generation performance. Indeed, we find empirical evidence that the discriminators are sensitive to the style (e.g., texture and color) of images. As a remedy, we propose feature statistics mixing regularization (FSMR) that encourages the discriminator's prediction to be invariant to the styles of input images. Specifically, we generate a mixed feature of an original and a reference image in the discriminator's feature space and we apply regularization so that the prediction for the mixed feature is consistent with the prediction for the original image. We conduct extensive experiments to demonstrate that our regularization leads to reduced sensitivity to style and consistently improves the performance of various GAN architectures on nine datasets. In addition, adding FSMR to recently-proposed augmentation-based GAN methods further improves image quality. Our code is available at https://github.com/naver-ai/FSMR.
Code (1)
Tasks
PredictionSimilar Papers 제목 키워드 기반
Improving Sequence Generative Adversarial Networks with Feature Statistics Alignment
Generative Adversarial Networks (GAN) are facing great challenges in synthesizing sequences of discrete elements, such as mode dropping and unstable training. The binary classifier in the discriminator may limit the capa…
Binary ClassificationPixel-to-Abundance Translation: Conditional Generative Adversarial Networks Based on Patch Transformer for Hyperspectral Unmixing
Spectral unmixing is a significant challenge in hyperspectral image processing. Existing unmixing methods utilize prior knowledge about the abundance distribution to solve the regularization optimization problem, where t…
Generative Adversarial NetworkHyperspectral UnmixingSemi-NMF Regularization-Based Autoencoder Training for Hyperspectral Unmixing
Hyperspectral Unmixing (HSU) refers to the procedure of decomposing measured pixel spectra into a set of constituent spectral signatures known as endmembers and a corresponding set of fractional mixing ratios. In this wo…
Hyperspectral UnmixingLearning to Learn Transferable Generative Attack for Person Re-Identification
Deep learning-based person re-identification (re-id) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider c…
Meta-LearningPerson Re-IdentificationPatchUp: A Feature-Space Block-Level Regularization Technique for Convolutional Neural Networks
Large capacity deep learning models are often prone to a high generalization gap when trained with a limited amount of labeled training data. A recent class of methods to address this problem uses various ways to constru…