Boosting Causal Additive Models

2024-01-12 · Maximilian Kertel, Nadja Klein

We present a boosting-based method to learn additive Structural Equation Models (SEMs) from observational data, with a focus on the theoretical aspects of determining the causal order among variables. We introduce a family of score functions based on arbitrary regression techniques, for which we establish necessary conditions to consistently favor the true causal ordering. Our analysis reveals that boosting with early stopping meets these criteria and thus offers a consistent score function for causal orderings. To address the challenges posed by high-dimensional data sets, we adapt our approach through a component-wise gradient descent in the space of additive SEMs. Our simulation study underlines our theoretical results for lower dimensions and demonstrates that our high-dimensional adaptation is competitive with state-of-the-art methods. In addition, it exhibits robustness with respect to the choice of the hyperparameters making the procedure easy to tune.

📄 PDF Abstract BibTeX arXiv:2401.06523

Code (0)

등록된 구현이 없습니다.

Tasks

Additive models

Methods 이 논문이 사용한 방법론

Early Stopping Early Stopping is a regularization technique for deep neural networks that stops training when parameter updates no longer begin to yield improves on a validation set. In…

Focus 설명 없음

Generalized Boosting

2020-12-01 · NeurIPS 2020 12 · Arun Suggala, Bingbin Liu, Pradeep Ravikumar

Boosting is a widely used learning technique in machine learning for solving classification problems. In boosting, one predicts the label of an example using an ensemble of weak classifiers. While boosting has shown trem…

Additive models Classification General Classification image-classification+1

Causal Discovery with Cascade Nonlinear Additive Noise Models

2019-05-23 · Ruichu Cai, Jie Qiao, Kun Zhang, Zhenjie Zhang 외

Identification of causal direction between a causal-effect pair from observed data has recently attracted much attention. Various methods based on functional causal models have been proposed to solve this problem, by ass…

Causal Discovery

Inference for $L_2$-Boosting

2018-05-04 · David Rügamer, Sonja Greven

We propose a statistical inference framework for the component-wise functional gradient descent algorithm (CFGD) under normality assumption for model errors, also known as $L_2$-Boosting. The CFGD is one of the most vers…

Variable Selection

Interpretable Machine Learning with an Ensemble of Gradient Boosting Machines

2020-10-14 · Andrei V. Konstantinov, Lev V. Utkin

A method for the local and global interpretation of a black-box model on the basis of the well-known generalized additive models is proposed. It can be viewed as an extension or a modification of the algorithm using the …

Additive models BIG-bench Machine Learning Interpretable Machine Learning

Consistency of Causal Inference under the Additive Noise Model

2013-12-19 · Samory Kpotufe, Eleni Sgouritsa, Dominik Janzing, Bernhard Schölkopf

We analyze a family of methods for statistical causal inference from sample under the so-called Additive Noise Model. While most work on the subject has concentrated on establishing the soundness of the Additive Noise Mo…

Causal Inference