paper-with-me

홈 › Papers

Causal Representation Learning from Multiple Distributions: A General Setting

2024-02-07 · Kun Zhang, Shaoan Xie, Ignavier Ng, Yujia Zheng

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or making proper changes to the system, it is helpful to recover the latent causal variables $Z_i$ and their causal relations represented by graph $\mathcal{G}_Z$. This problem has recently been known as causal representation learning. This paper is concerned with a general, completely nonparametric setting of causal representation learning from multiple distributions (arising from heterogeneous data or nonstationary time series), without assuming hard interventions behind distribution changes. We aim to develop general solutions in this fundamental case; as a by product, this helps see the unique benefit offered by other assumptions such as parametric causal models or hard interventions. We show that under the sparsity constraint on the recovered graph over the latent variables and suitable sufficient change conditions on the causal influences, interestingly, one can recover the moralized graph of the underlying directed acyclic graph, and the recovered latent variables and their relations are related to the underlying causal model in a specific, nontrivial way. In some cases, most latent variables can even be recovered up to component-wise transformations. Experimental results verify our theoretical claims.

📄 PDF Abstract BibTeX arXiv:2402.05052

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

When Distributions Shifts: Causal Generalization for Low-Resource Languages

2025-10-31 · Mahi Aliyu Aminu, Chisom Chibuike, Fatimo Adebanjo, Omokolade Awosanya 외 arxiv

Machine learning models often fail under distribution shifts, a problem exacerbated in low-resource settings where limited data restricts robust generalization. Domain generalization(DG) methods address this challenge by…

Representation LearningDomain GeneralizationSentiment AnalysisData Augmentation

Characterization and Learning of Causal Graphs from Hard Interventions

2025-05-02 · Zihan Zhou, Muhammad Qasim Elahi, Murat Kocaoglu

A fundamental challenge in the empirical sciences involves uncovering causal structure through observation and experimentation. Causal discovery entails linking the conditional independence (CI) invariances in observatio…

Causal Discovery

Nonparametric Identifiability of Causal Representations from Unknown Interventions

2023-06-01 · NeurIPS 2023 11 · Julius von Kügelgen, Michel Besserve, Liang Wendong, Luigi Gresele 외

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of cou…

counterfactualRepresentation Learning

Text-Driven Causal Representation Learning for Source-Free Domain Generalization

2025-07-14 · Lihua Zhou, Mao Ye, Nianxin Li, Shuaifeng Li 외 arxiv

Deep learning often struggles when training and test data distributions differ. Traditional domain generalization (DG) tackles this by including data from multiple source domains, which is impractical due to expensive da…

Representation LearningDomain GeneralizationData AugmentationCausal Inference

Nonlinear Invariant Risk Minimization: A Causal Approach

2021-02-24 · Chaochao Lu, Yuhuai Wu, Jośe Miguel Hernández-Lobato, Bernhard Schölkopf

Due to spurious correlations, machine learning systems often fail to generalize to environments whose distributions differ from the ones used at training time. Prior work addressing this, either explicitly or implicitly,…

BIG-bench Machine LearningRepresentation Learning