paper-with-me

Papers

Score matching through the roof: linear, nonlinear, and latent variables causal discovery

2024-07-26 · Francesco Montagna, Philipp M. Faller, Patrick Bloebaum, Elke Kirschbaum, Francesco Locatello

Causal discovery from observational data holds great promise, but existing methods rely on strong assumptions about the underlying causal structure, often requiring full observability of all relevant variables. We tackle these challenges by leveraging the score function $\nabla \log p(X)$ of observed variables for causal discovery and propose the following contributions. First, we fine-tune the existing identifiability results with the score on additive noise models, showing that their assumption of nonlinearity of the causal mechanisms is not necessary. Second, we establish conditions for inferring causal relations from the score even in the presence of hidden variables; this result is two-faced: we demonstrate the score's potential to infer the equivalence class of causal graphs with hidden variables (while previous results are restricted to the fully observable setting), and we provide sufficient conditions for identifying direct causes in latent variable models. Building on these insights, we propose a flexible algorithm suited for causal discovery on linear, nonlinear, and latent variable models, which we empirically validate.

📄 PDF Abstract BibTeX arXiv:2407.18755

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Discovery

Similar Papers 제목 키워드 기반

Shortcuts for causal discovery of nonlinear models by score matching

2023-10-22 · Francesco Montagna, Nicoletta Noceti, Lorenzo Rosasco, Francesco Locatello

The use of simulated data in the field of causal discovery is ubiquitous due to the scarcity of annotated real data. Recently, Reisach et al., 2021 highlighted the emergence of patterns in simulated linear data, which di…

Causal DiscoveryDiversity

What's the score? Automated Denoising Score Matching for Nonlinear Diffusions

2024-07-10 · Raghav Singhal, Mark Goldstein, Rajesh Ranganath

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear …

Denoising

The Score Kalman Filter

2026-05-15 · Kaito Iwasaki, Anthony Bloch, Taeyoung Lee, Maani Ghaffari arxiv

A central obstacle in nonlinear Bayesian filtering is representing the belief distribution. Moment-based filters address this by propagating polynomial moments and reconstructing a density from them. Recent work complete…

Nonlinear denoising score matching for enhanced learning of structured distributions

2024-05-24 · Jeremiah Birrell, Markos A. Katsoulakis, Luc Rey-Bellet, Benjamin Zhang 외

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structur…

Denoising

Latent Nonlinear Denoising Score Matching for Enhanced Learning of Structured Distributions

2025-12-07 · Kaichen Shen, Wei Zhu arxiv

We present latent nonlinear denoising score matching (LNDSM), a novel training objective for score-based generative models that integrates nonlinear forward dynamics with the VAE-based latent SGM framework. This combinat…