paper-with-me

Papers

Some Theoretical Insights into Wasserstein GANs

2020-06-04 · Gérard Biau, Maxime Sangnier, Ugo Tanielian

Generative Adversarial Networks (GANs) have been successful in producing outstanding results in areas as diverse as image, video, and text generation. Building on these successes, a large number of empirical studies have validated the benefits of the cousin approach called Wasserstein GANs (WGANs), which brings stabilization in the training process. In the present paper, we add a new stone to the edifice by proposing some theoretical advances in the properties of WGANs. First, we properly define the architecture of WGANs in the context of integral probability metrics parameterized by neural networks and highlight some of their basic mathematical features. We stress in particular interesting optimization properties arising from the use of a parametric 1-Lipschitz discriminator. Then, in a statistically-driven approach, we study the convergence of empirical WGANs as the sample size tends to infinity, and clarify the adversarial effects of the generator and the discriminator by underlining some trade-off properties. These features are finally illustrated with experiments using both synthetic and real-world datasets.

📄 PDF Abstract BibTeX arXiv:2006.02682

Code (0)

등록된 구현이 없습니다.

Tasks

Text Generation

Similar Papers 제목 키워드 기반

Wasserstein GANs Work Because They Fail (to Approximate the Wasserstein Distance)

2021-03-02 · Jan Stanczuk, Christian Etmann, Lisa Maria Kreusser, Carola-Bibiane Schönlieb

Wasserstein GANs are based on the idea of minimising the Wasserstein distance between a real and a generated distribution. We provide an in-depth mathematical analysis of differences between the theoretical setup and the…

(q,p)-Wasserstein GANs: Comparing Ground Metrics for Wasserstein GANs

2019-02-10 · Anton Mallasto, Jes Frellsen, Wouter Boomsma, Aasa Feragen

Generative Adversial Networks (GANs) have made a major impact in computer vision and machine learning as generative models. Wasserstein GANs (WGANs) brought Optimal Transport (OT) theory into GANs, by minimizing the $1$-…

Minimax Optimality (Probably) Doesn't Imply Distribution Learning for GANs

2022-01-18 · ICLR 2022 4 · Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka

Arguably the most fundamental question in the theory of generative adversarial networks (GANs) is to understand to what extent GANs can actually learn the underlying distribution. Theoretical and empirical evidence sugge…

Approximating Probability Distributions by using Wasserstein Generative Adversarial Networks

2021-03-18 · Yihang Gao, Michael K. Ng, Mingjie Zhou

Studied here are Wasserstein generative adversarial networks (WGANs) with GroupSort neural networks as their discriminators. It is shown that the error bound of the approximation for the target distribution depends on th…

Wasserstein Divergence for GANs

2017-12-04 · ECCV 2018 9 · Jiqing Wu, Zhiwu Huang, Janine Thoma, Dinesh Acharya 외

In many domains of computer vision, generative adversarial networks (GANs) have achieved great success, among which the family of Wasserstein GANs (WGANs) is considered to be state-of-the-art due to the theoretical contr…

Image Generation