paper-with-me

Papers

Environment-Adaptive Covariate Selection: Learning When to Use Spurious Correlations for Out-of-Distribution Prediction

2026-01-05 · Shuozhi Zuo, Yixin Wang arxiv

A common approach to out-of-distribution prediction restricts models to causal or invariant covariates to avoid spurious associations that may change across environments. Despite its theoretical appeal, this strategy can underperform empirical risk minimization when only a subset of the causal parents of the outcome is observed. In such settings, non-causal covariates can serve as proxies for unobserved causal parents and improve prediction when the proxy relationship is stable, but they can hurt when shifts disrupt that relationship. Thus, the optimal covariate set can depend on the specific shift encountered. Because different shifts leave signatures in the unlabeled covariate distribution, we propose an environment-adaptive covariate selection algorithm that maps environment-level summaries to environment-specific covariate sets. These summaries may be hand-crafted or learned from multi-environment data, and prior causal knowledge can be incorporated as constraints. Across simulations and applied datasets, the proposed method improves over static causal, invariant, and other non-adaptive rules under diverse shifts.

📄 PDF Abstract BibTeX arXiv:2601.02322

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Outcome-adaptive lasso: variable selection for causal inference

2017-03-08 · Biometrics 2017 3 · Susan M Shortreed, Ashkan Ertefaie

Methodological advancements, including propensity score methods, have resulted in improved unbiased estimation of treatment effects from observational data. Traditionally, a “throw in the kitchen sink” approach has been …

Causal InferenceVariable Selection

Variable Selection for Causal Inference via Outcome-Adaptive Random Forest

2021-09-09 · Daniel Jacob

Estimating a causal effect from observational data can be biased if we do not control for self-selection. This selection is based on confounding variables that affect the treatment assignment and the outcome. Propensity …

Causal InferenceVariable Selection

Continual Feature Selection: Spurious Features in Continual Learning

2022-03-02 · Timothée Lesort

Continual Learning (CL) is the research field addressing learning without forgetting when the data distribution is not static. This paper studies spurious features' influence on continual learning algorithms. We show tha…

Continual Learningfeature selection

Improving Knowledge Distillation Under Unknown Covariate Shift Through Confidence-Guided Data Augmentation

2025-06-02 · Niclas Popp, Kevin Alexander Laube, Matthias Hein, Lukas Schott arxiv

Large foundation models trained on extensive datasets demonstrate strong zero-shot capabilities in various domains. Knowledge distillation has become an established tool for transferring knowledge from foundation models …

Optimization-based Causal Estimation from Heterogenous Environments

2021-09-24 · Mingzhang Yin, Yixin Wang, David M. Blei

This paper presents a new optimization approach to causal estimation. Given data that contains covariates and an outcome, which covariates are causes of the outcome, and what is the strength of the causality? In classica…

Causal Inference