paper-with-me

홈 › Papers

Multi-Generator Generative Adversarial Nets

2017-08-08 · Quan Hoang, Tu Dinh Nguyen, Trung Le, Dinh Phung

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the original GAN. The idea is simple, yet proven to be extremely effective at covering diverse data modes, easily overcoming the mode collapse and delivering state-of-the-art results. A minimax formulation is able to establish among a classifier, a discriminator, and a set of generators in a similar spirit with GAN. Generators create samples that are intended to come from the same distribution as the training data, whilst the discriminator determines whether samples are true data or generated by generators, and the classifier specifies which generator a sample comes from. The distinguishing feature is that internal samples are created from multiple generators, and then one of them will be randomly selected as final output similar to the mechanism of a probabilistic mixture model. We term our method Mixture GAN (MGAN). We develop theoretical analysis to prove that, at the equilibrium, the Jensen-Shannon divergence (JSD) between the mixture of generators' distributions and the empirical data distribution is minimal, whilst the JSD among generators' distributions is maximal, hence effectively avoiding the mode collapse. By utilizing parameter sharing, our proposed model adds minimal computational cost to the standard GAN, and thus can also efficiently scale to large-scale datasets. We conduct extensive experiments on synthetic 2D data and natural image databases (CIFAR-10, STL-10 and ImageNet) to demonstrate the superior performance of our MGAN in achieving state-of-the-art Inception scores over latest baselines, generating diverse and appealing recognizable objects at different resolutions, and specializing in capturing different types of objects by generators.

📄 PDF Abstract BibTeX arXiv:1708.02556

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Temporal Generative Adversarial Nets with Singular Value Clipping

2016-11-21 · ICCV 2017 10 · Masaki Saito, Eiichi Matsumoto, Shunta Saito

In this paper, we propose a generative model, Temporal Generative Adversarial Nets (TGAN), which can learn a semantic representation of unlabeled videos, and is capable of generating videos. Unlike existing Generative Ad…

Video Generation

Conditional Generative Adversarial Nets

2014-11-06 · Mehdi Mirza, Simon Osindero

Generative Adversarial Nets [8] were recently introduced as a novel way to train generative models. In this work we introduce the conditional version of generative adversarial nets, which can be constructed by simply fee…

DescriptiveHuman action generation

GANITE: Estimation of Individualized Treatment Effects using Generative Adversarial Nets

2018-01-01 · ICLR 2018 1 · Jinsung Yoon, James Jordon, Mihaela van der Schaar

Estimating individualized treatment effects (ITE) is a challenging task due to the need for an individual's potential outcomes to be learned from biased data and without having access to the counterfactuals. We propose a…

Causal Inferencecounterfactual

MGAN: Training Generative Adversarial Nets with Multiple Generators

2018-01-01 · ICLR 2018 1 · Quan Hoang, Tu Dinh Nguyen, Trung Le, Dinh Phung

We propose in this paper a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead o…

Generative Ratio Matching Networks

2018-05-31 · ICLR 2020 1 · Akash Srivastava, Kai Xu, Michael U. Gutmann, Charles Sutton

Deep generative models can learn to generate realistic-looking images, but many of the most effective methods are adversarial and involve a saddlepoint optimization, which requires a careful balancing of training between…