Generative Adversarial Nets from a Density Ratio Estimation Perspective
Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when learning the generator. We propose a novel algorithm that repeats the density ratio estimation and f-divergence minimization. Our algorithm offers a new perspective toward the understanding of GANs and is able to make use of multiple viewpoints obtained in the research of density ratio estimation, e.g. what divergence is stable and relative density ratio is useful.
Code (0)
등록된 구현이 없습니다.
Tasks
Density Ratio EstimationSimilar Papers 제목 키워드 기반
Semi-supervised Learning on Graphs with Generative Adversarial Nets
We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel a…
A Generative Adversarial Density Estimator
Density estimation is a challenging unsupervised learning problem. Current maximum likelihood approaches for density estimation are either restrictive or incapable of producing high-quality samples. On the other hand, li…
Density EstimationVisual DialogTowards universal neural nets: Gibbs machines and ACE
We study from a physics viewpoint a class of generative neural nets, Gibbs machines, designed for gradual learning. While including variational auto-encoders, they offer a broader universal platform for incrementally add…
Density EstimationGeneral ClassificationRoundtrip: A Deep Generative Neural Density Estimator
Density estimation is a fundamental problem in both statistics and machine learning. In this study, we proposed Roundtrip as a general-purpose neural density estimator based on deep generative models. Roundtrip retains t…
BIG-bench Machine LearningDensity EstimationEMTL: A Generative Domain Adaptation Approach
We propose an unsupervised domain adaptation approach based on generative models. We show that when the source probability density function can be learned, one-step Expectation–Maximization iteration plus an additional m…
Density EstimationDomain AdaptationUnsupervised Domain Adaptation