Causally Disentangled Generative Variational AutoEncoder
We present a new supervised learning technique for the Variational AutoEncoder (VAE) that allows it to learn a causally disentangled representation and generate causally disentangled outcomes simultaneously. We call this approach Causally Disentangled Generation (CDG). CDG is a generative model that accurately decodes an output based on a causally disentangled representation. Our research demonstrates that adding supervised regularization to the encoder alone is insufficient for achieving a generative model with CDG, even for a simple task. Therefore, we explore the necessary and sufficient conditions for achieving CDG within a specific model. Additionally, we introduce a universal metric for evaluating the causal disentanglement of a generative model. Empirical results from both image and tabular datasets support our findings.
Code (1)
Tasks
DisentanglementSimilar Papers 제목 키워드 기반
Geometry of Deep Generative Models for Disentangled Representations
Deep generative models like variational autoencoders approximate the intrinsic geometry of high dimensional data manifolds by learning low-dimensional latent-space variables and an embedding function. The geometric prope…
Representation LearningLearning Disentangled Representations with Reference-Based Variational Autoencoders
Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically r…
AttributeConditional Image GenerationImage GenerationDisentangling Generative Factors in Natural Language with Discrete Variational Autoencoders
The ability of learning disentangled representations represents a major step for interpretable NLP systems as it allows latent linguistic features to be controlled. Most approaches to disentanglement rely on continuous v…
DisentanglementStyle TransferText Style TransferReference-based Variational Autoencoders
Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically r…
AttributeConditional Image GenerationImage GenerationDisentangling Generative Factors of Physical Fields Using Variational Autoencoders
The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational au…
Dimensionality ReductionDisentanglement