paper-with-me

홈 › Papers

The Bures Metric for Generative Adversarial Networks

2020-06-16 · Hannes De Meulemeester, Joachim Schreurs, Michaël Fanuel, Bart De Moor, Johan A. K. Suykens

Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping, i.e. the generative models not being able to sample from the entire probability distribution. To address this problem, we use the last layer of the discriminator as a feature map to study the distribution of the real and the fake data. During training, we propose to match the real batch diversity to the fake batch diversity by using the Bures distance between covariance matrices in feature space. The computation of the Bures distance can be conveniently done in either feature space or kernel space in terms of the covariance and kernel matrix respectively. We observe that diversity matching reduces mode collapse substantially and has a positive effect on the sample quality. On the practical side, a very simple training procedure, that does not require additional hyperparameter tuning, is proposed and assessed on several datasets.

📄 PDF Abstract BibTeX arXiv:2006.09096

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Similar Papers 제목 키워드 기반

The Bures Metric for Taming Mode Collapse in Generative Adversarial Networks

2020-09-28 · Hannes De Meulemeester, Joachim Schreurs, Michaël Fanuel, Bart De Moor 외

Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping, i.e. the gene…

Diversity

Max-sliced Bures Distance for Interpreting Discrepancies

2021-01-01 · Austin J. Brockmeier, Claudio Cesar Claros, Carlos H. Mendoza-Cardenas, Yüksel Karahan 외

We propose the max-sliced Bures distance, a lower bound on the max-sliced Wasserstein-2 distance, to identify the instances associated with the maximum discrepancy between two samples. By scoring instances by an energy-b…

Critical Points and Convergence Analysis of Generative Deep Linear Networks Trained with Bures-Wasserstein Loss

2023-03-06 · Pierre Bréchet, Katerina Papagiannouli, Jing An, Guido Montúfar

We consider a deep matrix factorization model of covariance matrices trained with the Bures-Wasserstein distance. While recent works have made advances in the study of the optimization problem for overparametrized low-ra…

Quantum Federated Learning Based on Bures--Uhlmann Geometry for Heterogeneous Noisy Clients

2026-08-28 · Haruki Emori, Masaki Uchihara, Yuuki Tokunaga arxiv

Quantum federated learning enables collaborative model training across quantum devices without sharing raw data, and it faces the data and hardware heterogeneity inherent to noisy quantum devices. Utilizing the quantum g…

Federated Learning

Bures-Wasserstein Importance-Weighted Evidence Lower Bound: Exposition and Applications

2026-02-04 · Peiwen Jiang, Takuo Matsubara, Minh-Ngoc Tran arxiv

The Importance-Weighted Evidence Lower Bound (IW-ELBO) has emerged as an effective objective for variational inference (VI), tightening the standard ELBO and mitigating the mode-seeking behaviour. However, optimizing the…