paper-with-me

Papers

Informative GANs via Structured Regularization of Optimal Transport

2019-12-04 · Pierre Bréchet, Tao Wu, Thomas Möllenhoff, Daniel Cremers

We tackle the challenge of disentangled representation learning in generative adversarial networks (GANs) from the perspective of regularized optimal transport (OT). Specifically, a smoothed OT loss gives rise to an implicit transportation plan between the latent space and the data space. Based on this theoretical observation, we exploit a structured regularization on the transportation plan to encourage a prescribed latent subspace to be informative. This yields the formulation of a novel informative OT-based GAN. By convex duality, we obtain the equivalent view that this leads to perturbed ground costs favoring sparsity in the informative latent dimensions. Practically, we devise a stable training algorithm for the proposed informative GAN. Our experiments support the hypothesis that such regularizations effectively yield the discovery of disentangled and interpretable latent representations. Our work showcases potential power of a regularized OT framework in the context of generative modeling through its access to the transport plan. Further challenges are addressed in this line.

📄 PDF Abstract BibTeX arXiv:1912.02160

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Optimal Transport Relaxations with Application to Wasserstein GANs

2019-06-07 · Saied Mahdian, Jose Blanchet, Peter Glynn

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The …

Kantorovich Strikes Back! Wasserstein GANs are not Optimal Transport?

2022-06-15 · Alexander Korotin, Alexander Kolesov, Evgeny Burnaev

Wasserstein Generative Adversarial Networks (WGANs) are the popular generative models built on the theory of Optimal Transport (OT) and the Kantorovich duality. Despite the success of WGANs, it is still unclear how well …

Training generative models from privatized data

2023-06-15 · Daria Reshetova, Wei-Ning Chen, Ayfer Özgür

Local differential privacy is a powerful method for privacy-preserving data collection. In this paper, we develop a framework for training Generative Adversarial Networks (GANs) on differentially privatized data. We show…

Privacy Preserving

DISTRIBUTIONAL CONCAVITY REGULARIZATION FOR GANS

2019-05-01 · ICLR 2019 5 · Shoichiro Yamaguchi, Masanori Koyama

We propose Distributional Concavity (DC) regularization for Generative Adversarial Networks (GANs), a functional gradient-based method that promotes the entropy of the generator distribution and works against mode collap…

SinSim: Sinkhorn-Regularized SimCLR

2025-02-13 · M. Hadi Sepanj, Paul Fiegth

Self-supervised learning has revolutionized representation learning by eliminating the need for labeled data. Contrastive learning methods, such as SimCLR, maximize the agreement between augmented views of an image but l…

Contrastive LearningRepresentation LearningSelf-Supervised Learning