paper-with-me

홈 › Papers

Improving Generative Adversarial Networks via Adversarial Learning in Latent Space

2021-09-29 · Yang Li, Yichuan Mo, Liangliang Shi, Junchi Yan, Xiaolu Zhang, Jun Zhou

Generative Adversarial Networks (GANs) have been widely studied as generative models, which map a latent distribution to the target distribution. Although many efforts have been made in terms of backbone architecture design, loss function, and training techniques, few results have been obtained on how the sampling in latent space can affect the final performance, and existing works on latent space mainly focus on controllability. We observe that, as the neural generator is a continuous function, two close samples in latent space would be mapped into two nearby images, while their quality can differ much as the quality is not a continuous function in pixel space. From the above continuous mapping function perspective, on the other hand, two distant latent samples are also possible to be mapped into two close images. If the latent samples are mapped in aggregation into limited modes or even a single mode, mode collapse occurs. Accordingly, we propose adding an implicit latent transform before the mapping function to improve latent $z$ from its initial distribution, e.g., Gaussian. This is achieved by using the iterative fast gradient sign method (I-FGSM). We further propose new GAN training strategies to obtain better generation mappings w.r.t quality and diversity by introducing targeted latent transforms into the bi-level optimization of GAN. Experimental results on visual data show that our method can effectively achieve improvement in both quality and diversity.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Similar Papers 제목 키워드 기반

MaskAAE: Latent space optimization for Adversarial Auto-Encoders

2019-12-10 · Arnab Kumar Mondal, Sankalan Pal Chowdhury, Aravind Jayendran, Parag Singla 외

The field of neural generative models is dominated by the highly successful Generative Adversarial Networks (GANs) despite their challenges, such as training instability and mode collapse. Auto-Encoders (AE) with regular…

On the Adversarial Robustness of Generative Autoencoders in the Latent Space

2023-07-05 · Mingfei Lu, Badong Chen

The generative autoencoders, such as the variational autoencoders or the adversarial autoencoders, have achieved great success in lots of real-world applications, including image generation, and signal communication. How…

Adversarial Robustnesscompressed sensingDecoderDisentanglement+1

Generative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourage convex latent distributions

2018-07-17 · Tim Sainburg, Marvin Thielk, Brad Theilman, Benjamin Migliori 외

We present a neural network architecture based upon the Autoencoder (AE) and Generative Adversarial Network (GAN) that promotes a convex latent distribution by training adversarially on latent space interpolations. By us…

Generative Adversarial Network

Generative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourages convex latent distributions

2018-09-27 · Tim Sainburg, Marvin Thielk, Brad Thielman, Benjamin Migliori 외

We present a neural network architecture based upon the Autoencoder (AE) and Generative Adversarial Network (GAN) that promotes a convex latent distribution by training adversarially on latent space interpolations. By us…

Generative Adversarial Network

Generating Adversarial Attacks in the Latent Space

2023-04-10 · Nitish Shukla, Sudipta Banerjee

Adversarial attacks in the input (pixel) space typically incorporate noise margins such as $L_1$ or $L_{\infty}$-norm to produce imperceptibly perturbed data that confound deep learning networks. Such noise margins confi…

Adversarial AttackGenerative Adversarial Network