paper-with-me

Papers

DAG-aware Transformer for Causal Effect Estimation

2024-10-13 · Manqing Liu, David R. Bellamy, Andrew L. Beam

Causal inference is a critical task across fields such as healthcare, economics, and the social sciences. While recent advances in machine learning, especially those based on the deep-learning architectures, have shown potential in estimating causal effects, existing approaches often fall short in handling complex causal structures and lack adaptability across various causal scenarios. In this paper, we present a novel transformer-based method for causal inference that overcomes these challenges. The core innovation of our model lies in its integration of causal Directed Acyclic Graphs (DAGs) directly into the attention mechanism, enabling it to accurately model the underlying causal structure. This allows for flexible estimation of both average treatment effects (ATE) and conditional average treatment effects (CATE). Extensive experiments on both synthetic and real-world datasets demonstrate that our approach surpasses existing methods in estimating causal effects across a wide range of scenarios. The flexibility and robustness of our model make it a valuable tool for researchers and practitioners tackling complex causal inference problems.

📄 PDF Abstract BibTeX arXiv:2410.10044

Code (1)

ManqingLiu/DAGawareTransformer 공식 구현 jax

Tasks

Causal Inference

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Similar Papers 제목 키워드 기반

To Predict or to Reject: Causal Effect Estimation with Uncertainty on Networked Data

2023-09-15 · Hechuan Wen, Tong Chen, Li Kheng Chai, Shazia Sadiq 외

Due to the imbalanced nature of networked observational data, the causal effect predictions for some individuals can severely violate the positivity/overlap assumption, rendering unreliable estimations. Nevertheless, thi…

Domain-Agnostic Causal-Aware Audio Transformer for Infant Cry Classification

2025-12-18 · Geofrey Owino, Bernard Shibwabo Kasamani, Ahmed M. Abdelmoniem, Edem Wornyo arxiv

Accurate and interpretable classification of infant cry paralinguistics is essential for early detection of neonatal distress and clinical decision support. However, many existing deep learning methods rely on correlatio…

Representation LearningDomain GeneralizationMulti-Task Learning

CETransformer: Casual Effect Estimation via Transformer Based Representation Learning

2021-07-19 · Zhenyu Guo, Shuai Zheng, Zhizhe Liu, Kun Yan 외

Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. A…

counterfactualRepresentation LearningSelection bias

MCCE: Missingness-aware Causal Concept Explainer

2024-11-14 · Jifan Gao, Guanhua Chen

Causal concept effect estimation is gaining increasing interest in the field of interpretable machine learning. This general approach explains the behaviors of machine learning models by estimating the causal effect of h…

Interpretable Machine Learning

CausalFormer: An Interpretable Transformer for Temporal Causal Discovery

2024-06-24 · Lingbai Kong, Wengen Li, Hanchen Yang, Yichao Zhang 외

Temporal causal discovery is a crucial task aimed at uncovering the causal relations within time series data. The latest temporal causal discovery methods usually train deep learning models on prediction tasks to uncover…

Causal DiscoveryTime Series