paper-with-me

Papers

Probably approximately correct high-dimensional causal effect estimation given a valid adjustment set

2024-11-12 · Davin Choo, Chandler Squires, Arnab Bhattacharyya, David Sontag

Accurate estimates of causal effects play a key role in decision-making across applications such as healthcare, economics, and operations. In the absence of randomized experiments, a common approach to estimating causal effects uses \textit{covariate adjustment}. In this paper, we study covariate adjustment for discrete distributions from the PAC learning perspective, assuming knowledge of a valid adjustment set $\bZ$, which might be high-dimensional. Our first main result PAC-bounds the estimation error of covariate adjustment by a term that is exponential in the size of the adjustment set; it is known that such a dependency is unavoidable even if one only aims to minimize the mean squared error. Motivated by this result, we introduce the notion of an \emph{$\eps$-Markov blanket}, give bounds on the misspecification error of using such a set for covariate adjustment, and provide an algorithm for $\eps$-Markov blanket discovery; our second main result upper bounds the sample complexity of this algorithm. Furthermore, we provide a misspecification error bound and a constraint-based algorithm that allow us to go beyond $\eps$-Markov blankets to even smaller adjustment sets. Our third main result upper bounds the sample complexity of this algorithm, and our final result combines the first three into an overall PAC bound. Altogether, our results highlight that one does not need to perfectly recover causal structure in order to ensure accurate estimates of causal effects.

📄 PDF Abstract BibTeX arXiv:2411.08141

Code (0)

등록된 구현이 없습니다.

Tasks

PAC learningvalid

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Probably Approximately Correct Causal Discovery

2025-07-25 · Mian Wei, Somesh Jha, David Page arxiv

The discovery of causal relationships is a foundational problem in artificial intelligence, statistics, epidemiology, economics, and beyond. While elegant theories exist for accurate causal discovery given infinite data,…

On the Usability of Probably Approximately Correct Implication Bases

2017-01-04 · Daniel Borchmann, Tom Hanika, Sergei Obiedkov

We revisit the notion of probably approximately correct implication bases from the literature and present a first formulation in the language of formal concept analysis, with the goal to investigate whether such bases re…

The Probably Approximately Correct Learning Model in Computational Learning Theory

2025-11-11 · Rocco A. Servedio arxiv

This survey paper gives an overview of various known results on learning classes of Boolean functions in Valiant's Probably Approximately Correct (PAC) learning model and its commonly studied variants.

Probably Approximately Correct Explanations of Machine Learning Models via Syntax-Guided Synthesis

2020-09-18 · Daniel Neider, Bishwamittra Ghosh

We propose a novel approach to understanding the decision making of complex machine learning models (e.g., deep neural networks) using a combination of probably approximately correct learning (PAC) and a logic inference …

BIG-bench Machine LearningDecision Making

PACSBO: Probably approximately correct safe Bayesian optimization

2024-09-02 · Abdullah Tokmak, Thomas B. Schön, Dominik Baumann

Safe Bayesian optimization (BO) algorithms promise to find optimal control policies without knowing the system dynamics while at the same time guaranteeing safety with high probability. In exchange for those guarantees, …

Bayesian Optimization