paper-with-me

홈 › Papers

Primal-Dual Wasserstein GAN

2018-05-24 · Mevlana Gemici, Zeynep Akata, Max Welling

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal formulation to learn a flexible inference mechanism and to create an optimal approximate coupling between the data distribution and the generative model. In order to learn the generative model, we use the dual formulation and train the decoder adversarially through a critic network that is regularized by the approximate coupling obtained from the primal. Unlike previous methods that violate various properties of the optimal critic, we regularize the norm and the direction of the gradients of the critic function. Our model shares many of the desirable properties of auto-encoding models in terms of mode coverage and latent structure, while avoiding their undesirable averaging properties, e.g. their inability to capture sharp visual features when modeling real images. We compare our algorithm with several other generative modeling techniques that utilize Wasserstein distances on Frechet Inception Distance (FID) and Inception Scores (IS).

📄 PDF Abstract BibTeX arXiv:1805.09575

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Fast Algorithms for Computational Optimal Transport and Wasserstein Barycenter

2019-05-23 · Wenshuo Guo, Nhat Ho, Michael. I. Jordan

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over stat…

Offline Imitation from Observation via Primal Wasserstein State Occupancy Matching

2023-11-02 · Kai Yan, Alexander G. Schwing, Yu-Xiong Wang

In real-world scenarios, arbitrary interactions with the environment can often be costly, and actions of expert demonstrations are not always available. To reduce the need for both, offline Learning from Observations (Lf…

Optimal Transport Barycenter via Nonconvex-Concave Minimax Optimization

2025-01-24 · Kaheon Kim, Rentian Yao, Changbo Zhu, Xiaohui Chen

The optimal transport barycenter (a.k.a. Wasserstein barycenter) is a fundamental notion of averaging that extends from the Euclidean space to the Wasserstein space of probability distributions. Computation of the unregu…

Wasserstein Contrastive Representation Distillation

2020-12-15 · CVPR 2021 1 · Liqun Chen, Dong Wang, Zhe Gan, Jingjing Liu 외

The primary goal of knowledge distillation (KD) is to encapsulate the information of a model learned from a teacher network into a student network, with the latter being more compact than the former. Existing work, e.g.,…

Contrastive LearningKnowledge DistillationModel CompressionTransfer Learning

Training Generative Adversarial Networks via Primal-Dual Subgradient Methods: A Lagrangian Perspective on GAN

2018-02-06 · ICLR 2018 1 · Xu Chen, Jiang Wang, Hao Ge

We relate the minimax game of generative adversarial networks (GANs) to finding the saddle points of the Lagrangian function for a convex optimization problem, where the discriminator outputs and the distribution of gene…