Evaluating Causal Models by Comparing Interventional Distributions
The predominant method for evaluating the quality of causal models is to measure the graphical accuracy of the learned model structure. We present an alternative method for evaluating causal models that directly measures the accuracy of estimated interventional distributions. We contrast such distributional measures with structural measures, such as structural Hamming distance and structural intervention distance, showing that structural measures often correspond poorly to the accuracy of estimated interventional distributions. We use a number of real and synthetic datasets to illustrate various scenarios in which structural measures provide misleading results with respect to algorithm selection and parameter tuning, and we recommend that distributional measures become the new standard for evaluating causal models.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Characterization and Learning of Causal Graphs from Hard Interventions
A fundamental challenge in the empirical sciences involves uncovering causal structure through observation and experimentation. Causal discovery entails linking the conditional independence (CI) invariances in observatio…
Causal DiscoveryEstimating Joint interventional distributions from marginal interventional data
In this paper we show how to exploit interventional data to acquire the joint conditional distribution of all the variables using the Maximum Entropy principle. To this end, we extend the Causal Maximum Entropy method to…
feature selectionA Ladder of Causal Distances
Causal discovery, the task of automatically constructing a causal model from data, is of major significance across the sciences. Evaluating the performance of causal discovery algorithms should ideally involve comparing …
BenchmarkingCausal DiscoverycounterfactualCausal Adversarial Network for Learning Conditional and Interventional Distributions
We propose a generative Causal Adversarial Network (CAN) for learning and sampling from conditional and interventional distributions. In contrast to the existing CausalGAN which requires the causal graph to be given, our…
Conditional Image GenerationFace GenerationImage GenerationCausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Data
Causal inference is a vital aspect of multiple scientific disciplines and is routinely applied to high-impact applications such as medicine. However, evaluating the performance of causal inference methods in real-world e…
Causal DiscoveryCausal InferenceDrug Discovery