Causal Modeling with Stationary Diffusions

2023-10-26 · Lars Lorch, Andreas Krause, Bernhard Schölkopf

We develop a novel approach towards causal inference. Rather than structural equations over a causal graph, we learn stochastic differential equations (SDEs) whose stationary densities model a system's behavior under interventions. These stationary diffusion models do not require the formalism of causal graphs, let alone the common assumption of acyclicity. We show that in several cases, they generalize to unseen interventions on their variables, often better than classical approaches. Our inference method is based on a new theoretical result that expresses a stationarity condition on the diffusion's generator in a reproducing kernel Hilbert space. The resulting kernel deviation from stationarity (KDS) is an objective function of independent interest.

📄 PDF Abstract BibTeX arXiv:2310.17405

Code (1)

larslorch/stadion 공식 구현 jax

Tasks

Causal Inference

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Latent Causal Diffusions for Single-Cell Perturbation Modeling

2026-01-20 · Lars Lorch, Jiaqi Zhang, Charlotte Bunne, Andreas Krause 외 arxiv

Perturbation screens hold the potential to systematically map regulatory processes at single-cell resolution, yet modeling and predicting transcriptome-wide responses to perturbations remains a major computational challe…

Causal Inference

Causal Discovery from Conditionally Stationary Time Series

2021-10-12 · Carles Balsells-Rodas, Ruibo Tu, Hedvig Kjellstrom, Yingzhen Li

Causal discovery, i.e., inferring underlying causal relationships from observational data, has been shown to be highly challenging for AI systems. In time series modeling context, traditional causal discovery methods mai…

Causal Discovery Causal Inference Probabilistic Deep Learning Time Series+1

Learning Multiscale Non-stationary Causal Structures

2022-08-31 · Gabriele D'Acunto, Gianmarco De Francisci Morales, Paolo Bajardi, Francesco Bonchi

This paper addresses a gap in the current state of the art by providing a solution for modeling causal relationships that evolve over time and occur at different time scales. Specifically, we introduce the multiscale non…

Time Series Time Series Analysis Variational Inference

Stationary Density Estimation of Itô Diffusions Using Deep Learning

2021-09-09 · Yiqi Gu, John Harlim, Senwei Liang, Haizhao Yang

In this paper, we consider the density estimation problem associated with the stationary measure of ergodic It\^o diffusions from a discrete-time series that approximate the solutions of the stochastic differential equat…

Deep Learning Density Estimation regression Time Series+1

Intervention-based Recurrent Casual Model for Non-stationary Video Causal Discovery

2021-09-29 · Yuke Li, Kenneth Li, Pin Wang, Donglai Wei 외

Non-stationary casual structures are prevalent in real-world physical systems. For example, the stacked blocks interacted with one another until they fall apart, while the billiard balls are moving independently until th…

Causal Discovery counterfactual Counterfactual Reasoning