Entropic Causal Inference: Identifiability and Finite Sample Results

2021-01-10 · NeurIPS 2020 12 · Spencer Compton, Murat Kocaoglu, Kristjan Greenewald, Dmitriy Katz

Entropic causal inference is a framework for inferring the causal direction between two categorical variables from observational data. The central assumption is that the amount of unobserved randomness in the system is not too large. This unobserved randomness is measured by the entropy of the exogenous variable in the underlying structural causal model, which governs the causal relation between the observed variables. Kocaoglu et al. conjectured that the causal direction is identifiable when the entropy of the exogenous variable is not too large. In this paper, we prove a variant of their conjecture. Namely, we show that for almost all causal models where the exogenous variable has entropy that does not scale with the number of states of the observed variables, the causal direction is identifiable from observational data. We also consider the minimum entropy coupling-based algorithmic approach presented by Kocaoglu et al., and for the first time demonstrate algorithmic identifiability guarantees using a finite number of samples. We conduct extensive experiments to evaluate the robustness of the method to relaxing some of the assumptions in our theory and demonstrate that both the constant-entropy exogenous variable and the no latent confounder assumptions can be relaxed in practice. We also empirically characterize the number of observational samples needed for causal identification. Finally, we apply the algorithm on Tuebingen cause-effect pairs dataset.

📄 PDF Abstract BibTeX arXiv:2101.03501

Code (0)

등록된 구현이 없습니다.

Tasks

Causal IdentificationCausal Inference

Methods 이 논문이 사용한 방법론

Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Entropic Causal Inference: Graph Identifiability

2025-09-19 · Spencer Compton, Kristjan Greenewald, Dmitriy Katz, Murat Kocaoglu arxiv

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the …

Causal Inference

Beyond identifiability: Learning causal representations with few environments and finite samples

2026-03-26 · Inbeom Lee, Tongtong Jin, Bryon Aragam arxiv

We provide explicit, finite-sample guarantees for learning causal representations from data with a sublinear number of environments. Causal representation learning seeks to provide a rigourous foundation for the general …

Representation Learning

SBI: A Simulation-Based Test of Identifiability for Bayesian Causal Inference

2021-02-23 · Sam Witty, David Jensen, Vikash Mansinghka

A growing family of approaches to causal inference rely on Bayesian formulations of assumptions that go beyond causal graph structure. For example, Bayesian approaches have been developed for analyzing instrumental varia…

Causal Inference Experimental Design Gaussian Processes

Estimating Causal Effects in Gaussian Linear SCMs with Finite Data

2026-01-08 · Aurghya Maiti, Prateek Jain arxiv

Estimating causal effects from observational data remains a fundamental challenge in causal inference, especially in the presence of latent confounders. This paper focuses on estimating causal effects in Gaussian Linear …