paper-with-me

Papers

Causal learning with sufficient statistics: an information bottleneck approach

2020-10-12 · Daniel Chicharro, Michel Besserve, Stefano Panzeri

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional independencies between variables of a system are common tools for this purpose, but are limited in the lack of independencies. To surmount this limitation, we capitalize on the fact that the laws governing the generative mechanisms of a system often result in substructures embodied in the generative functional equation of a variable, which act as sufficient statistics for the influence that other variables have on it. These functional sufficient statistics constitute intermediate hidden variables providing new conditional independencies to be tested. We propose to use the Information Bottleneck method, a technique commonly applied for dimensionality reduction, to find underlying sufficient sets of statistics. Using these statistics we formulate new additional rules of causal orientation that provide causal information not obtainable from standard structure learning algorithms, which exploit only conditional independencies between observable variables. We validate the use of sufficient statistics for structure learning both with simulated systems built to contain specific sufficient statistics and with benchmark data from regulatory rules previously and independently proposed to model biological signal transduction networks.

📄 PDF Abstract BibTeX arXiv:2010.05375

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reduction

Similar Papers 제목 키워드 기반

Structural Causal Bottleneck Models

2026-03-09 · Simon Bing, Jonas Wahl, Jakob Runge arxiv

We introduce structural causal bottleneck models (SCBMs), a novel class of structural causal models. At the core of SCBMs lies the assumption that causal effects between high-dimensional variables only depend on low-dime…

Representation LearningTransfer Learning

Trimming the Independent Fat: Sufficient Statistics, Mutual Information, and Predictability from Effective Channel States

2017-02-07 · Ryan G. James, John R. Mahoney, James P. Crutchfield

One of the most fundamental questions one can ask about a pair of random variables X and Y is the value of their mutual information. Unfortunately, this task is often stymied by the extremely large dimension of the varia…

Visualizing Information Bottleneck through Variational Inference

2022-12-24 · Cipta Herwana, Abhishek Kadian

The Information Bottleneck theory provides a theoretical and computational framework for finding approximate minimum sufficient statistics. Analysis of the Stochastic Gradient Descent (SGD) training of a neural network o…

Variational Inference

Causal Discovery in the Presence of Measurement Error: Identifiability Conditions

2017-06-10 · Kun Zhang, Mingming Gong, Joseph Ramsey, Kayhan Batmanghelich 외

Measurement error in the observed values of the variables can greatly change the output of various causal discovery methods. This problem has received much attention in multiple fields, but it is not clear to what extent…

Causal Discovery

Cause-Effect Deep Information Bottleneck For Systematically Missing Covariates

2018-07-06 · Sonali Parbhoo, Mario Wieser, Aleksander Wieczorek, Volker Roth

Estimating the causal effects of an intervention from high-dimensional observational data is difficult due to the presence of confounding. The task is often complicated by the fact that we may have a systematic missingne…

Causal Inference