paper-with-me

Papers

Causal Autoregressive Flows

2020-11-04 · Ilyes Khemakhem, Ricardo Pio Monti, Robert Leech, Aapo Hyvärinen

Two apparently unrelated fields -- normalizing flows and causality -- have recently received considerable attention in the machine learning community. In this work, we highlight an intrinsic correspondence between a simple family of autoregressive normalizing flows and identifiable causal models. We exploit the fact that autoregressive flow architectures define an ordering over variables, analogous to a causal ordering, to show that they are well-suited to performing a range of causal inference tasks, ranging from causal discovery to making interventional and counterfactual predictions. First, we show that causal models derived from both affine and additive autoregressive flows with fixed orderings over variables are identifiable, i.e. the true direction of causal influence can be recovered. This provides a generalization of the additive noise model well-known in causal discovery. Second, we derive a bivariate measure of causal direction based on likelihood ratios, leveraging the fact that flow models can estimate normalized log-densities of data. Third, we demonstrate that flows naturally allow for direct evaluation of both interventional and counterfactual queries, the latter case being possible due to the invertible nature of flows. Finally, throughout a series of experiments on synthetic and real data, the proposed method is shown to outperform current approaches for causal discovery as well as making accurate interventional and counterfactual predictions.

📄 PDF Abstract BibTeX arXiv:2011.02268

Code (2)

piomonti/carefl 공식 구현 pytorch
piomonti/AffineFlowCausalInf pytorch

Tasks

Causal DiscoveryCausal Inferencecounterfactual

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Similar Papers 제목 키워드 기반

Autoregressive flow-based causal discovery and inference

2020-07-18 · Ricardo Pio Monti, Ilyes Khemakhem, Aapo Hyvarinen

We posit that autoregressive flow models are well-suited to performing a range of causal inference tasks - ranging from causal discovery to making interventional and counterfactual predictions. In particular, we exploit …

Causal DiscoveryCausal Inferencecounterfactual

Causal normalizing flows: from theory to practice

2023-06-08 · NeurIPS 2023 11 · Adrián Javaloy, Pablo Sánchez-Martín, Isabel Valera

In this work, we deepen on the use of normalizing flows for causal reasoning. Specifically, we first leverage recent results on non-linear ICA to show that causal models are identifiable from observational data given a c…

counterfactual

STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

2026-05-08 · Ying Shen, Tianrong Chen, Yuan Gao, Yizhe Zhang 외 arxiv

Deep generative models have advanced rapidly across text and vision, motivating unified multimodal systems that can understand, reason over, and generate interleaved text-image sequences. Most existing approaches combine…

multimodal generationImage GenerationText Generation

STARFlow-V: End-to-End Video Generative Modeling with Normalizing Flows

2025-11-25 · Jiatao Gu, Ying Shen, Tianrong Chen, Laurent Dinh 외 arxiv

Normalizing flows (NFs) are end-to-end likelihood-based generative models for continuous data, and have recently regained attention with encouraging progress on image generation. Yet in the video generation domain, where…

Video GenerationImage Generation

Neural Autoregressive Flows for Markov Boundary Learning

2026-03-21 · Khoa Nguyen, Bao Duong, Viet Huynh, Thin Nguyen arxiv

Recovering Markov boundary -- the minimal set of variables that maximizes predictive performance for a response variable -- is crucial in many applications. While recent advances improve upon traditional constraint-based…