paper-with-me

홈 › Papers

Stein Latent Optimization for Generative Adversarial Networks

2021-06-09 · ICLR 2022 4 · Uiwon Hwang, Heeseung Kim, Dahuin Jung, Hyemi Jang, Hyungyu Lee, Sungroh Yoon

Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of existing unsupervised conditional GANs cannot cluster attributes of these data in their latent spaces properly because they assume uniform distributions of the attributes. To address this problem, we theoretically derive Stein latent optimization that provides reparameterizable gradient estimations of the latent distribution parameters assuming a Gaussian mixture prior in a continuous latent space. Structurally, we introduce an encoder network and novel unsupervised conditional contrastive loss to ensure that data generated from a single mixture component represent a single attribute. We confirm that the proposed method, named Stein Latent Optimization for GANs (SLOGAN), successfully learns balanced or imbalanced attributes and achieves state-of-the-art unsupervised conditional generation performance even in the absence of attribute information (e.g., the imbalance ratio). Moreover, we demonstrate that the attributes to be learned can be manipulated using a small amount of probe data.

📄 PDF Abstract BibTeX arXiv:2106.05319

Code (1)

shinyflight/SLOGAN 공식 구현 tf

Tasks

Attribute

Similar Papers 제목 키워드 기반

Wasserstein-Wasserstein Auto-Encoders

2019-02-25 · Shunkang Zhang, Yuan Gao, Yuling Jiao, Jin Liu 외

To address the challenges in learning deep generative models (e.g.,the blurriness of variational auto-encoder and the instability of training generative adversarial networks, we propose a novel deep generative model, nam…

Inferential Wasserstein Generative Adversarial Networks

2021-09-13 · Yao Chen, Qingyi Gao, Xiao Wang

Generative Adversarial Networks (GANs) have been impactful on many problems and applications but suffer from unstable training. The Wasserstein GAN (WGAN) leverages the Wasserstein distance to avoid the caveats in the mi…

Wasserstein Adversarially Regularized Graph Autoencoder

2021-11-09 · Huidong Liang, Junbin Gao

This paper introduces Wasserstein Adversarially Regularized Graph Autoencoder (WARGA), an implicit generative algorithm that directly regularizes the latent distribution of node embedding to a target distribution via the…

ClusteringLink PredictionNode Clustering

Adaptive Learning of the Latent Space of Wasserstein Generative Adversarial Networks

2024-09-27 · Yixuan Qiu, Qingyi Gao, Xiao Wang

Generative models based on latent variables, such as generative adversarial networks (GANs) and variational auto-encoders (VAEs), have gained lots of interests due to their impressive performance in many fields. However,…

From optimal transport to generative modeling: the VEGAN cookbook

2017-05-22 · Olivier Bousquet, Sylvain Gelly, Ilya Tolstikhin, Carl-Johann Simon-Gabriel 외

We study unsupervised generative modeling in terms of the optimal transport (OT) problem between true (but unknown) data distribution $P_X$ and the latent variable model distribution $P_G$. We show that the OT problem ca…