paper-with-me

홈 › Papers

Variance Minimization in the Wasserstein Space for Invariant Causal Prediction

2021-10-13 · Guillaume Martinet, Alexander Strzalkowski, Barbara E. Engelhardt

Selecting powerful predictors for an outcome is a cornerstone task for machine learning. However, some types of questions can only be answered by identifying the predictors that causally affect the outcome. A recent approach to this causal inference problem leverages the invariance property of a causal mechanism across differing experimental environments (Peters et al., 2016; Heinze-Deml et al., 2018). This method, invariant causal prediction (ICP), has a substantial computational defect -- the runtime scales exponentially with the number of possible causal variables. In this work, we show that the approach taken in ICP may be reformulated as a series of nonparametric tests that scales linearly in the number of predictors. Each of these tests relies on the minimization of a novel loss function -- the Wasserstein variance -- that is derived from tools in optimal transport theory and is used to quantify distributional variability across environments. We prove under mild assumptions that our method is able to recover the set of identifiable direct causes, and we demonstrate in our experiments that it is competitive with other benchmark causal discovery algorithms.

📄 PDF Abstract BibTeX arXiv:2110.07064

Code (1)

astrzalk/wvm_reproducibility 공식 구현

Tasks

Causal DiscoveryCausal Inference

Similar Papers 제목 키워드 기반

Integrated Latent Heterogeneity and Invariance Learning in Kernel Space

2021-12-01 · NeurIPS 2021 12 · Jiashuo Liu, Zheyuan Hu, Peng Cui, Bo Li 외

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learn…

Invariant Risk Minimization

2019-07-05 · Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, David Lopez-Paz

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal …

Domain GeneralizationImage ClassificationOut-of-Distribution Generalization

Robust Reconfigurable Intelligent Surfaces via Invariant Risk and Causal Representations

2021-05-04 · Sumudu Samarakoon, Jihong Park, Mehdi Bennis

In this paper, the problem of robust reconfigurable intelligent surface (RIS) system design under changes in data distributions is investigated. Using the notion of invariant risk minimization (IRM), an invariant causal …

Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition

2017-08-08 · Ran He, Xiang Wu, Zhenan Sun, Tieniu Tan

Heterogeneous face recognition (HFR) aims to match facial images acquired from different sensing modalities with mission-critical applications in forensics, security and commercial sectors. However, HFR is a much more ch…

Face RecognitionHeterogeneous Face Recognition

Unsupervised Invariant Risk Minimization

2025-05-18 · Yotam Norman, Ron Meir

We propose a novel unsupervised framework for \emph{Invariant Risk Minimization} (IRM), extending the concept of invariance to settings where labels are unavailable. Traditional IRM methods rely on labeled data to learn …

Representation Learning