High Precision Causal Model Evaluation with Conditional Randomization
The gold standard for causal model evaluation involves comparing model predictions with true effects estimated from randomized controlled trials (RCT). However, RCTs are not always feasible or ethical to perform. In contrast, conditionally randomized experiments based on inverse probability weighting (IPW) offer a more realistic approach but may suffer from high estimation variance. To tackle this challenge and enhance causal model evaluation in real-world conditional randomization settings, we introduce a novel low-variance estimator for causal error, dubbed as the pairs estimator. By applying the same IPW estimator to both the model and true experimental effects, our estimator effectively cancels out the variance due to IPW and achieves a smaller asymptotic variance. Empirical studies demonstrate the improved of our estimator, highlighting its potential on achieving near-RCT performance. Our method offers a simple yet powerful solution to evaluate causal inference models in conditional randomization settings without complicated modification of the IPW estimator itself, paving the way for more robust and reliable model assessments.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferencemodelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
On the Optimality of Randomization in Experimental Design: How to Randomize for Minimax Variance and Design-Based Inference
I study the minimax-optimal design for a two-arm controlled experiment where conditional mean outcomes may vary in a given set. When this set is permutation symmetric, the optimal design is complete randomization, and us…
Experimental DesignLearning Treatment Effects during Resource Allocation via Priority-Queue Randomization
Public service programs often allocate limited resources under uncertainty about their benefits, creating a need for randomization to support credible evaluation. In practice, however, applicants commonly enter waitlists…
Statistical Methods for cis-Mendelian Randomization with Two-sample Summary-level Data
Mendelian randomization is the use of genetic variants to assess the existence of a causal relationship between a risk factor and an outcome of interest. Here, we focus on two-sample summary-data Mendelian randomization …
Variable SelectionUnconditional Randomization Tests for Interference
When conducting causal inference or designing policy, researchers are often concerned with the existence and extent of interference between units, which may be influenced by factors such as distance, proximity, and conne…
Causal InferencevalidTesting Conditional Independence on Discrete Data using Stochastic Complexity
Testing for conditional independence is a core aspect of constraint-based causal discovery. Although commonly used tests are perfect in theory, they often fail to reject independence in practice, especially when conditio…
Causal Discovery