Conditional Inference in Pre-trained Variational Autoencoders via Cross-coding
Variational Autoencoders (VAEs) are a popular generative model, but one in which conditional inference can be challenging. If the decomposition into query and evidence variables is fixed, conditional VAEs provide an attractive solution. To support arbitrary queries, one is generally reduced to Markov Chain Monte Carlo sampling methods that can suffer from long mixing times. In this paper, we propose an idea we term cross-coding to approximate the distribution over the latent variables after conditioning on an evidence assignment to some subset of the variables. This allows generating query samples without retraining the full VAE. We experimentally evaluate three variations of cross-coding showing that (i) they can be quickly optimized for different decompositions of evidence and query and (ii) they quantitatively and qualitatively outperform Hamiltonian Monte Carlo.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bridging the inference gap in Mutimodal Variational Autoencoders
From medical diagnosis to autonomous vehicles, critical applications rely on the integration of multiple heterogeneous data modalities. Multimodal Variational Autoencoders offer versatile and scalable methods for generat…
Autonomous VehiclesMedical DiagnosisVariational InferenceLearning Conditional Variational Autoencoders with Missing Covariates
Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes tha…
Missing ValuesVariational InferenceHierarchical Bayes Autoencoders
Autoencoders are powerful generative models for complex data, such as images. However, standard models like the variational autoencoder (VAE) typically have unimodal Gaussian decoders, which cannot effectively represent …
DecoderVariational InferenceAnomaly Detection With Conditional Variational Autoencoders
Exploiting the rapid advances in probabilistic inference, in particular variational Bayes and variational autoencoders (VAEs), for anomaly detection (AD) tasks remains an open research question. Previous works argued tha…
Anomaly DetectionDeep Variational Inference Without Pixel-Wise Reconstruction
Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on ma…
Variational Inference