paper-with-me

홈 › Papers

Bias Correction of Learned Generative Models via Likelihood-free Importance Weighting

2019-03-27 · ICLR Workshop DeepGenStruct 2019 · Aditya Grover, Jiaming Song, Ashish Kapoor, Kenneth Tran, Alekh Agarwal, Eric Horvitz, Stefano Ermon

A learned generative model often gives biased statistics relative to the underlying data distribution. A standard technique to correct this bias is by importance weighting samples from the model by the likelihood ratio under the model and true distributions. When the likelihood ratio is unknown, it can be estimated by training a probabilistic classifier to distinguish samples from the two distributions. In this paper, we employ this likelihood-free importance weighting framework to correct for the bias in using state-of-the-art deep generative models.We find that this technique consistently improves standard goodness-of-fit metrics for evaluating the sample quality of state-of-the-art generative models, suggesting reduced bias. Finally, we demonstrate its utility on representative applications in a) data augmentation for classification using generative adversarial networks, and b) model-based policy evaluation using off-policy data.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Bias Correction of Learned Generative Models using Likelihood-Free Importance Weighting

2019-06-23 · NeurIPS 2019 12 · Aditya Grover, Jiaming Song, Alekh Agarwal, Kenneth Tran 외

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the…

Data Augmentation

Class-Incremental Learning with Generative Classifiers

2021-04-20 · Gido M. van de Ven, Zhe Li, Andreas S. Tolias

Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 're…

class-incremental learningClass Incremental LearningContinual LearningIncremental Learning

Robust outlier detection by de-biasing VAE likelihoods

2021-08-19 · CVPR 2022 1 · Kushal Chauhan, Barath Mohan U, Pradeep Shenoy, Manish Gupta 외

Deep networks often make confident, yet, incorrect, predictions when tested with outlier data that is far removed from their training distributions. Likelihoods computed by deep generative models (DGMs) are a candidate m…

DecoderOutlier Detection

Improving Maximum Likelihood Training for Text Generation with Density Ratio Estimation

2020-07-12 · Yuxuan Song, Ning Miao, Hao Zhou, Lantao Yu 외

Auto-regressive sequence generative models trained by Maximum Likelihood Estimation suffer the exposure bias problem in practical finite sample scenarios. The crux is that the number of training samples for Maximum Likel…

Density Ratio EstimationDiversityText Generation

Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference

2026-04-20 · Jonas Arruda, Sophie Chervet, Paula Staudt, Andreas Wieser 외 arxiv

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. …

Bayesian Inference