paper-with-me

홈 › Papers

Directing Generative Networks with Weighted Maximum Mean Discrepancy

2018-01-01 · ICLR 2018 1 · Maurice Diesendruck, Guy W. Cole, Sinead Williamson

The maximum mean discrepancy (MMD) between two probability measures P and Q is a metric that is zero if and only if all moments of the two measures are equal, making it an appealing statistic for two-sample tests. Given i.i.d. samples from P and Q, Gretton et al. (2012) show that we can construct an unbiased estimator for the square of the MMD between the two distributions. If P is a distribution of interest and Q is the distribution implied by a generative neural network with stochastic inputs, we can use this estimator to train our neural network. However, in practice we do not always have i.i.d. samples from our target of interest. Data sets often exhibit biases—for example, under-representation of certain demographics—and if we ignore this fact our machine learning algorithms will propagate these biases. Alternatively, it may be useful to assume our data has been gathered via a biased sample selection mechanism in order to manipulate properties of the estimating distribution Q. In this paper, we construct an estimator for the MMD between P and Q when we only have access to P via some biased sample selection mechanism, and suggest methods for estimating this sample selection mechanism when it is not already known. We show that this estimator can be used to train generative neural networks on a biased data sample, to give a simulator that reverses the effect of that bias.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Unified Joint Maximum Mean Discrepancy for Domain Adaptation

2021-01-25 · Wei Wang, Baopu Li, Shuhui Yang, Jing Sun 외

Domain adaptation has received a lot of attention in recent years, and many algorithms have been proposed with impressive progress. However, it is still not fully explored concerning the joint probability distribution (P…

Domain Adaptation

Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation

2017-05-01 · CVPR 2017 7 · Hongliang Yan, Yukang Ding, Peihua Li, Qilong Wang 외

In domain adaptation, maximum mean discrepancy (MMD) has been widely adopted as a discrepancy metric between the distributions of source and target domains. However, existing MMD-based domain adaptation methods generally…

Domain AdaptationUnsupervised Domain Adaptation

Conditional Generative Moment-Matching Networks

2016-06-14 · NeurIPS 2016 12 · Yong Ren, Jialian Li, Yucen Luo, Jun Zhu

Maximum mean discrepancy (MMD) has been successfully applied to learn deep generative models for characterizing a joint distribution of variables via kernel mean embedding. In this paper, we present conditional generativ…

Bounding the Error From Reference Set Kernel Maximum Mean Discrepancy

2018-12-11 · Alexander Cloninger

In this paper, we bound the error induced by using a weighted skeletonization of two data sets for computing a two sample test with kernel maximum mean discrepancy. The error is quantified in terms of the speed in which …

Universal Approximation of Residual Flows in Maximum Mean Discrepancy

2021-03-10 · ICML Workshop INNF 2021 7 · Zhifeng Kong, Kamalika Chaudhuri

Normalizing flows are a class of flexible deep generative models that offer easy likelihood computation. Despite their empirical success, there is little theoretical understanding of their expressiveness. In this work, w…