paper-with-me

Papers

Improved Consistency Regularization for GANs

2020-02-11 · Zhengli Zhao, Sameer Singh, Honglak Lee, Zizhao Zhang, Augustus Odena, Han Zhang

Recent work has increased the performance of Generative Adversarial Networks (GANs) by enforcing a consistency cost on the discriminator. We improve on this technique in several ways. We first show that consistency regularization can introduce artifacts into the GAN samples and explain how to fix this issue. We then propose several modifications to the consistency regularization procedure designed to improve its performance. We carry out extensive experiments quantifying the benefit of our improvements. For unconditional image synthesis on CIFAR-10 and CelebA, our modifications yield the best known FID scores on various GAN architectures. For conditional image synthesis on CIFAR-10, we improve the state-of-the-art FID score from 11.48 to 9.21. Finally, on ImageNet-2012, we apply our technique to the original BigGAN model and improve the FID from 6.66 to 5.38, which is the best score at that model size.

📄 PDF Abstract BibTeX arXiv:2002.04724

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Conditional Batch Normalization Conditional Batch Normalization (CBN) is a class-conditional variant of batch normalization. The key idea is to…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
TTUR The Two Time-scale Update Rule (TTUR) is an update rule for generative adversarial networks trained with stochastic gradient descent. TTUR has an individual learning rate for…
GAN Hinge Loss The GAN Hinge Loss is a hinge loss based loss function for [generative adversarial…

Similar Papers 제목 키워드 기반

Orthogonal Wasserstein GANs

2019-11-29 · Jan Müller, Reinhard Klein, Michael Weinmann

Wasserstein-GANs have been introduced to address the deficiencies of generative adversarial networks (GANs) regarding the problems of vanishing gradients and mode collapse during the training, leading to improved converg…

Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation

2020-02-29 · Takehiko Ohkawa, Naoto Inoue, Hirokatsu Kataoka, Nakamasa Inoue

Unpaired image-to-image (I2I) translation has received considerable attention in pattern recognition and computer vision because of recent advancements in generative adversarial networks (GANs). However, due to the lack …

Data AugmentationImage-to-Image TranslationTranslation

Image Augmentations for GAN Training

2020-06-04 · Zhengli Zhao, Zizhao Zhang, Ting Chen, Sameer Singh 외

Data augmentations have been widely studied to improve the accuracy and robustness of classifiers. However, the potential of image augmentation in improving GAN models for image synthesis has not been thoroughly investig…

Image AugmentationImage Generation

An Improved Composite Functional Gradient Learning by Wasserstein Regularization for Generative adversarial networks

2021-09-29 · Chang Wan, Yanwei Fu, Ke Fan, Jinshan Zeng 외

Generative adversarial networks (GANs) are usually trained by a minimax game which is notoriously and empirically known to be unstable. Recently, a totally new methodology called Composite Functional Gradient Learning (…

Image Generationregression

Pairing Regularization for Mitigating Many-to-One Collapse in GANs

2026-04-22 · Kuan-Yu Lin, Yu-Chih Huang, Tie Liu arxiv

Mode collapse remains a fundamental challenge in training generative adversarial networks (GANs). While existing works have primarily focused on inter-mode collapse, such as mode dropping, intra-mode collapse-where many …