paper-with-me

Papers

Generative Models and Model Criticism via Optimized Maximum Mean Discrepancy

2016-11-14 · Danica J. Sutherland, Hsiao-Yu Tung, Heiko Strathmann, Soumyajit De, Aaditya Ramdas, Alex Smola, Arthur Gretton

We propose a method to optimize the representation and distinguishability of samples from two probability distributions, by maximizing the estimated power of a statistical test based on the maximum mean discrepancy (MMD). This optimized MMD is applied to the setting of unsupervised learning by generative adversarial networks (GAN), in which a model attempts to generate realistic samples, and a discriminator attempts to tell these apart from data samples. In this context, the MMD may be used in two roles: first, as a discriminator, either directly on the samples, or on features of the samples. Second, the MMD can be used to evaluate the performance of a generative model, by testing the model's samples against a reference data set. In the latter role, the optimized MMD is particularly helpful, as it gives an interpretable indication of how the model and data distributions differ, even in cases where individual model samples are not easily distinguished either by eye or by classifier.

📄 PDF Abstract BibTeX arXiv:1611.04488

Code (1)

dougalsutherland/opt-mmd 공식 구현 tf

Similar Papers 제목 키워드 기반

Statistical Model Criticism using Kernel Two Sample Tests

2015-12-01 · NeurIPS 2015 12 · James R. Lloyd, Zoubin Ghahramani

We propose an exploratory approach to statistical model criticism using maximum mean discrepancy (MMD) two sample tests. Typical approaches to model criticism require a practitioner to select a statistic by which to meas…

modelVocal Bursts Valence Prediction

Ensemble Transport Filter via Optimized Maximum Mean Discrepancy

2024-07-16 · Dengfei Zeng, Lijian Jiang

In this paper, we present a new ensemble-based filter method by reconstructing the analysis step of the particle filter through a transport map, which directly transports prior particles to posterior particles. The trans…

Conditional Generative Moment-Matching Networks

2016-06-14 · NeurIPS 2016 12 · Yong Ren, Jialian Li, Yucen Luo, Jun Zhu

Maximum mean discrepancy (MMD) has been successfully applied to learn deep generative models for characterizing a joint distribution of variables via kernel mean embedding. In this paper, we present conditional generativ…

Universal Approximation of Residual Flows in Maximum Mean Discrepancy

2021-03-10 · ICML Workshop INNF 2021 7 · Zhifeng Kong, Kamalika Chaudhuri

Normalizing flows are a class of flexible deep generative models that offer easy likelihood computation. Despite their empirical success, there is little theoretical understanding of their expressiveness. In this work, w…

Generative neural networks for characteristic functions

2024-01-09 · Florian Brück

We provide a simulation algorithm to simulate from a (multivariate) characteristic function, which is only accessible in a black-box format. The method is based on a generative neural network, whose loss function exploit…