paper-with-me

홈 › Papers

Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference

2026-06-02 · Roman Plaud, Alexandre Perez-Lebel, Antoine Saillenfest, Thomas Bonald, Marine Le Morvan, Gaël Varoquaux, Matthieu Labeau arxiv

Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation. This disconnect is especially critical in Inverse Probability Weighting (IPW) for causal inference, where propensity score errors near $0$ and $1$ often lead to high bias and variance. We propose a principled framework for deriving task-specific strictly proper scoring rules by matching the local curvature of the downstream error metric. We apply this to the Average Treatment Effect (ATE) estimation, deriving a closed-form loss and its corresponding canonical probability mapping that can be readily integrated with any model like a neural network or a gradient boosting algorithm. Extensive evaluations on causal inference benchmarks demonstrate that our tailored objective consistently outperforms standard likelihood-based and covariate-balancing approaches.

📄 PDF Abstract BibTeX arXiv:2606.03332

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Inference

Similar Papers 제목 키워드 기반

Language Generation with Strictly Proper Scoring Rules

2024-05-29 · Chenze Shao, Fandong Meng, Yijin Liu, Jie zhou

Language generation based on maximum likelihood estimation (MLE) has become the fundamental approach for text generation. Maximum likelihood estimation is typically performed by minimizing the log-likelihood loss, also k…

Language ModelingLanguage Modellingscoring ruleText Generation

Proper Scoring Rules for Survival Analysis

2023-05-01 · Hiroki Yanagisawa

Survival analysis is the problem of estimating probability distributions for future event times, which can be seen as a problem in uncertainty quantification. Although there are fundamental theories on strictly proper sc…

Survival AnalysisUncertainty Quantification

Strictly Proper Kernel Scoring Rules and Divergences with an Application to Kernel Two-Sample Hypothesis Testing

2017-04-09 · Hamed Masnadi-Shirazi

We study strictly proper scoring rules in the Reproducing Kernel Hilbert Space. We propose a general Kernel Scoring rule and associated Kernel Divergence. We consider conditions under which the Kernel Score is strictly p…

One-class classifierscoring ruleTwo-sample testing

The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting

2026-05-08 · Lauri Lovén, Sasu Tarkoma arxiv

Eliciting truthful reports from autonomous agents is a core problem in scalable AI oversight: a principal scores the agent's report using a strictly proper scoring rule, but the agent also benefits from the report throug…

Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules

2026-03-09 · Jonas Landsgesell, Pascal Knoll, Tizian Wenzel arxiv

Modern tabular foundation models such as TabPFN and TabICL naturally produce full predictive distributions, while the benchmarks used to evaluate them (TabArena, TALENT, and others) still rely almost exclusively on point…