paper-with-me

Papers

Identifying Linearly-Mixed Causal Representations from Multi-Node Interventions

2023-11-05 · Simon Bing, Urmi Ninad, jonas Wahl, Jakob Runge

The task of inferring high-level causal variables from low-level observations, commonly referred to as causal representation learning, is fundamentally underconstrained. As such, recent works to address this problem focus on various assumptions that lead to identifiability of the underlying latent causal variables. A large corpus of these preceding approaches consider multi-environment data collected under different interventions on the causal model. What is common to virtually all of these works is the restrictive assumption that in each environment, only a single variable is intervened on. In this work, we relax this assumption and provide the first identifiability result for causal representation learning that allows for multiple variables to be targeted by an intervention within one environment. Our approach hinges on a general assumption on the coverage and diversity of interventions across environments, which also includes the shared assumption of single-node interventions of previous works. The main idea behind our approach is to exploit the trace that interventions leave on the variance of the ground truth causal variables and regularizing for a specific notion of sparsity with respect to this trace. In addition to and inspired by our theoretical contributions, we present a practical algorithm to learn causal representations from multi-node interventional data and provide empirical evidence that validates our identifiability results.

📄 PDF Abstract BibTeX arXiv:2311.02695

Code (1)

simonbing/multi-node-crl 공식 구현 pytorch

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Identifying Macro Causal Effects in C-DMGs over DMGs

2025-06-24 · Simon Ferreira, Charles K. Assaad

The do-calculus is a sound and complete tool for identifying causal effects in acyclic directed mixed graphs (ADMGs) induced by structural causal models (SCMs). However, in many real-world applications, especially in hig…

Multi-Domain Empirical Bayes for Linearly-Mixed Causal Representations

2026-03-19 · Bohan Wu, Julius von Kügelgen, David M. Blei arxiv

Causal representation learning (CRL) aims to learn low-dimensional causal latent variables from high-dimensional observations. While identifiability has been extensively studied for CRL, estimation has been less explored…

Representation Learning

Spectral estimation for mixed causal-noncausal autoregressive models

2022-11-24 · Alain Hecq, Daniel Velasquez-Gaviria

This paper investigates new ways of estimating and identifying causal, noncausal, and mixed causal-noncausal autoregressive models driven by a non-Gaussian error sequence. We do not assume any parametric distribution fun…

Identifying while Learning for Document Event Causality Identification

2024-05-31 · Cheng Liu, Wei Xiang, Bang Wang

Event Causality Identification (ECI) aims to detect whether there exists a causal relation between two events in a document. Existing studies adopt a kind of identifying after learning paradigm, where events' representat…

Causal IdentificationEvent Causality Identification

The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets

2023-10-10 · Samuel Marks, Max Tegmark

Large Language Models (LLMs) have impressive capabilities, but are prone to outputting falsehoods. Recent work has developed techniques for inferring whether a LLM is telling the truth by training probes on the LLM's int…

Language ModelingLanguage ModellingLarge Language Model