Robust Estimation of Causal Heteroscedastic Noise Models
Distinguishing the cause and effect from bivariate observational data is the foundational problem that finds applications in many scientific disciplines. One solution to this problem is assuming that cause and effect are generated from a structural causal model, enabling identification of the causal direction after estimating the model in each direction. The heteroscedastic noise model is a type of structural causal model where the cause can contribute to both the mean and variance of the noise. Current methods for estimating heteroscedastic noise models choose the Gaussian likelihood as the optimization objective which can be suboptimal and unstable when the data has a non-Gaussian distribution. To address this limitation, we propose a novel approach to estimating this model with Student's $t$-distribution, which is known for its robustness in accounting for sampling variability with smaller sample sizes and extreme values without significantly altering the overall distribution shape. This adaptability is beneficial for capturing the parameters of the noise distribution in heteroscedastic noise models. Our empirical evaluations demonstrate that our estimators are more robust and achieve better overall performance across synthetic and real benchmarks.
Code (1)
Similar Papers 제목 키워드 기반
A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery
Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery. In this work, we explore heteroscedastic symmetric noise mode…
Causal DiscoveryHeteroscedastic Causal Structure Learning
Heretofore, learning the directed acyclic graphs (DAGs) that encode the cause-effect relationships embedded in observational data is a computationally challenging problem. A recent trend of studies has shown that it is p…
validEffective Causal Discovery under Identifiable Heteroscedastic Noise Model
Capturing the underlying structural causal relations represented by Directed Acyclic Graphs (DAGs) has been a fundamental task in various AI disciplines. Causal DAG learning via the continuous optimization framework has …
Causal DiscoverymodelSpectral identification and estimation of mixed causal-noncausal invertible-noninvertible models
This paper introduces new techniques for estimating, identifying and simulating mixed causal-noncausal invertible-noninvertible models. We propose a framework that integrates high-order cumulants, merging both the spectr…
Assessing the overall and partial causal well-specification of nonlinear additive noise models
We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cas…