Causal vs. Anticausal merging of predictors
We study the differences arising from merging predictors in the causal and anticausal directions using the same data. In particular we study the asymmetries that arise in a simple model where we merge the predictors using one binary variable as target and two continuous variables as predictors. We use Causal Maximum Entropy (CMAXENT) as inductive bias to merge the predictors, however, we expect similar differences to hold also when we use other merging methods that take into account asymmetries between cause and effect. We show that if we observe all bivariate distributions, the CMAXENT solution reduces to a logistic regression in the causal direction and Linear Discriminant Analysis (LDA) in the anticausal direction. Furthermore, we study how the decision boundaries of these two solutions differ whenever we observe only some of the bivariate distributions implications for Out-Of-Variable (OOV) generalisation.
Code (0)
등록된 구현이 없습니다.
Tasks
Inductive BiasMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Physics-Based Causal Lifting Linearization of Nonlinear Control Systems Underpinned by the Koopman Operator
Methods for constructing causal linear models from nonlinear dynamical systems through lifting linearization underpinned by Koopman operator and physical system modeling theory are presented. Outputs of a nonlinear contr…
Causal-Anticausal Decomposition of Speech using Complex Cepstrum for Glottal Source Estimation
Complex cepstrum is known in the literature for linearly separating causal and anticausal components. Relying on advances achieved by the Zeros of the Z-Transform (ZZT) technique, we here investigate the possibility of u…
Identification of non-causal systems with random switching modes (Extended Version)
We consider the identification of non-causal systems with random switching modes (NCSRSM), a class of models essential for describing typical power load management and department store inventory dynamics. The simultaneou…
Managementparameter estimationComplex Cepstrum-based Decomposition of Speech for Glottal Source Estimation
Homomorphic analysis is a well-known method for the separation of non-linearly combined signals. More particularly, the use of complex cepstrum for source-tract deconvolution has been discussed in various articles. Howev…
ArticlesCausality-aware counterfactual confounding adjustment as an alternative to linear residualization in anticausal prediction tasks based on linear learners
Linear residualization is a common practice for confounding adjustment in machine learning (ML) applications. Recently, causality-aware predictive modeling has been proposed as an alternative causality-inspired approach …
counterfactualregression