paper-with-me

Papers

Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanisms

2023-06-02 · Aneesh Komanduri, Yongkai Wu, Feng Chen, Xintao Wu

Learning disentangled causal representations is a challenging problem that has gained significant attention recently due to its implications for extracting meaningful information for downstream tasks. In this work, we define a new notion of causal disentanglement from the perspective of independent causal mechanisms. We propose ICM-VAE, a framework for learning causally disentangled representations supervised by causally related observed labels. We model causal mechanisms using nonlinear learnable flow-based diffeomorphic functions to map noise variables to latent causal variables. Further, to promote the disentanglement of causal factors, we propose a causal disentanglement prior learned from auxiliary labels and the latent causal structure. We theoretically show the identifiability of causal factors and mechanisms up to permutation and elementwise reparameterization. We empirically demonstrate that our framework induces highly disentangled causal factors, improves interventional robustness, and is compatible with counterfactual generation.

📄 PDF Abstract BibTeX arXiv:2306.01213

Code (1)

akomand/icm-vae 공식 구현 pytorch

Tasks

counterfactualDisentanglement

Similar Papers 제목 키워드 기반

On Causally Disentangled Representations

2021-12-10 · Abbavaram Gowtham Reddy, Benin Godfrey L, Vineeth N Balasubramanian

Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised mode…

DisentanglementFairness

Weakly Supervised Disentangled Generative Causal Representation Learning

2020-10-06 · Xinwei Shen, Furui Liu, Hanze Dong, Qing Lian 외

This paper proposes a Disentangled gEnerative cAusal Representation (DEAR) learning method under appropriate supervised information. Unlike existing disentanglement methods that enforce independence of the latent variabl…

DisentanglementRepresentation Learning

Intervening to Learn and Compose Causally Disentangled Representations

2025-07-07 · Alex Markham, Isaac Hirsch, Jeri A. Chang, Liam Solus 외 arxiv

In designing generative models, it is commonly believed that in order to learn useful latent structure, we face a fundamental tension between expressivity and structure. In this paper we challenge this view by proposing …

Causally Disentangled Generative Variational AutoEncoder

2023-02-23 · SeungHwan An, Kyungwoo Song, Jong-June Jeon

We present a new supervised learning technique for the Variational AutoEncoder (VAE) that allows it to learn a causally disentangled representation and generate causally disentangled outcomes simultaneously. We call this…

Disentanglement

C-Disentanglement: Discovering Causally-Independent Generative Factors under an Inductive Bias of Confounder

2023-10-26 · NeurIPS 2023 11 · Xiaoyu Liu, Jiaxin Yuan, Bang An, Yuancheng Xu 외

Representation learning assumes that real-world data is generated by a few semantically meaningful generative factors (i.e., sources of variation) and aims to discover them in the latent space. These factors are expected…

DisentanglementInductive BiasRepresentation Learning