paper-with-me

Papers

Causal Machine Learning Methods for Estimating Personalised Treatment Effects -- Insights on validity from two large trials

2025-01-07 · Hongruyu Chen, Helena Aebersold, Milo Alan Puhan, Miquel Serra-Burriel

Causal machine learning (ML) methods hold great promise for advancing precision medicine by estimating personalized treatment effects. However, their reliability remains largely unvalidated in empirical settings. In this study, we assessed the internal and external validity of 17 mainstream causal heterogeneity ML methods -- including metalearners, tree-based methods, and deep learning methods -- using data from two large randomized controlled trials: the International Stroke Trial (N=19,435) and the Chinese Acute Stroke Trial (N=21,106). Our findings reveal that none of the ML methods reliably validated their performance, neither internal nor external, showing significant discrepancies between training and test data on the proposed evaluation metrics. The individualized treatment effects estimated from training data failed to generalize to the test data, even in the absence of distribution shifts. These results raise concerns about the current applicability of causal ML models in precision medicine, and highlight the need for more robust validation techniques to ensure generalizability.

📄 PDF Abstract BibTeX arXiv:2501.04061

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Identify treatment effect patterns for personalised decisions

2019-06-14 · Jiuyong Li, Lin Liu, Shisheng Zhang, Saisai Ma 외

In personalised decision making, evidence is required to determine whether an action (treatment) is suitable for an individual. Such evidence can be obtained by modelling treatment effect heterogeneity in subgroups. The …

Decision Making

Linking a predictive model to causal effect estimation

2023-04-10 · Jiuyong Li, Lin Liu, Ziqi Xu, Ha Xuan Tran 외

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal e…

Decision MakingFairnessmodel

Estimating the average causal effect of intervention in continuous variables using machine learning

2022-03-08 · Yoshiaki Kitazawa

The most widely discussed methods for estimating the Average Causal Effect/Average Treatment Effect are those for intervention in discrete binary variables whose value represents intervention/non-intervention groups. On …

BIG-bench Machine Learning

Data-Driven Estimation of Heterogeneous Treatment Effects

2023-01-16 · Christopher Tran, Keith Burghardt, Kristina Lerman, Elena Zheleva

Estimating how a treatment affects different individuals, known as heterogeneous treatment effect estimation, is an important problem in empirical sciences. In the last few years, there has been a considerable interest i…

counterfactualHeterogeneous Treatment Effect Estimation

Causal machine learning for predicting treatment outcomes

2024-10-11 · Stefan Feuerriegel, Dennis Frauen, Valentyn Melnychuk, Jonas Schweisthal 외

Causal machine learning (ML) offers flexible, data-driven methods for predicting treatment outcomes including efficacy and toxicity, thereby supporting the assessment and safety of drugs. A key benefit of causal ML is th…

Decision Making