paper-with-me

Papers

Learning GANs and Ensembles Using Discrepancy

2019-10-20 · NeurIPS 2019 12 · Ben Adlam, Corinna Cortes, Mehryar Mohri, Ningshan Zhang

Generative adversarial networks (GANs) generate data based on minimizing a divergence between two distributions. The choice of that divergence is therefore critical. We argue that the divergence must take into account the hypothesis set and the loss function used in a subsequent learning task, where the data generated by a GAN serves for training. Taking that structural information into account is also important to derive generalization guarantees. Thus, we propose to use the discrepancy measure, which was originally introduced for the closely related problem of domain adaptation and which precisely takes into account the hypothesis set and the loss function. We show that discrepancy admits favorable properties for training GANs and prove explicit generalization guarantees. We present efficient algorithms using discrepancy for two tasks: training a GAN directly, namely DGAN, and mixing previously trained generative models, namely EDGAN. Our experiments on toy examples and several benchmark datasets show that DGAN is competitive with other GANs and that EDGAN outperforms existing GAN ensembles, such as AdaGAN.

📄 PDF Abstract BibTeX arXiv:1910.08965

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Ensembles of Generative Adversarial Networks

2016-12-03 · Yaxing Wang, Lichao Zhang, Joost Van de Weijer

Ensembles are a popular way to improve results of discriminative CNNs. The combination of several networks trained starting from different initializations improves results significantly. In this paper we investigate the …

GAN Ensemble for Anomaly Detection

2020-12-14 · Xu Han, Xiaohui Chen, Li-Ping Liu

When formulated as an unsupervised learning problem, anomaly detection often requires a model to learn the distribution of normal data. Previous works apply Generative Adversarial Networks (GANs) to anomaly detection tas…

Anomaly Detection

Selecting the Best in GANs Family: a Post Selection Inference Framework

2018-02-15 · Yao-Hung Hubert Tsai, Makoto Yamada, Denny Wu, Ruslan Salakhutdinov 외

"Which Generative Adversarial Networks (GANs) generates the most plausible images?" has been a frequently asked question among researchers. To address this problem, we first propose an \emph{incomplete} U-statistics esti…

Ensembles of Generative Adversarial Networks for Disconnected Data

2020-06-25 · Lorenzo Luzi, Randall Balestriero, Richard G. Baraniuk

Most current computer vision datasets are composed of disconnected sets, such as images from different classes. We prove that distributions of this type of data cannot be represented with a continuous generative network …

The Detection of Distributional Discrepancy for Text Generation

2019-09-28 · Xingyuan Chen, Ping Cai, Peng Jin, Haokun Du 외

The text generated by neural language models is not as good as the real text. This means that their distributions are different. Generative Adversarial Nets (GAN) are used to alleviate it. However, some researchers argue…

Language ModelingLanguage ModellingText Generation