paper-with-me

홈 › Papers

Improving Model Robustness Using Causal Knowledge

2019-11-27 · Trent Kyono, Mihaela van der Schaar

For decades, researchers in fields, such as the natural and social sciences, have been verifying causal relationships and investigating hypotheses that are now well-established or understood as truth. These causal mechanisms are properties of the natural world, and thus are invariant conditions regardless of the collection domain or environment. We show in this paper how prior knowledge in the form of a causal graph can be utilized to guide model selection, i.e., to identify from a set of trained networks the models that are the most robust and invariant to unseen domains. Our method incorporates prior knowledge (which can be incomplete) as a Structural Causal Model (SCM) and calculates a score based on the likelihood of the SCM given the target predictions of a candidate model and the provided input variables. We show on both publicly available and synthetic datasets that our method is able to identify more robust models in terms of generalizability to unseen out-of-distribution test examples and domains where covariates have shifted.

📄 PDF Abstract BibTeX arXiv:1911.12441

Code (0)

등록된 구현이 없습니다.

Tasks

modelModel Selection

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Weakly-supervised causal discovery based on fuzzy knowledge and complex data complementarity

2024-05-14 · Wenrui Li, Wei zhang, Qinghao Zhang, Xuegong Zhang 외

Causal discovery based on observational data is important for deciphering the causal mechanism behind complex systems. However, the effectiveness of existing causal discovery methods is limited due to inferior prior know…

Causal DiscoveryComputational Efficiency

Causality-Inspired Robustness for Nonlinear Models via Representation Learning

2025-05-19 · Marin Šola, Peter Bühlmann, Xinwei Shen

Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, …

Representation Learning

Enhancing Model Robustness and Fairness with Causality: A Regularization Approach

2021-10-03 · EMNLP (CINLP) 2021 11 · Zhao Wang, Kai Shu, Aron Culotta

Recent work has raised concerns on the risk of spurious correlations and unintended biases in statistical machine learning models that threaten model robustness and fairness. In this paper, we propose a simple and intuit…

Causal InferencecounterfactualFairness

RobustCLEVR: A Benchmark and Framework for Evaluating Robustness in Object-centric Learning

2023-08-28 · Nathan Drenkow, Mathias Unberath

Object-centric representation learning offers the potential to overcome limitations of image-level representations by explicitly parsing image scenes into their constituent components. While image-level representations t…

Image GenerationObjectRepresentation Learning

Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach

2025-07-23 · Minh-Duong Nguyen, Quoc-Viet Pham, Nguyen H. Tran, Hoang-Khoi Do 외 arxiv

In this study, we design a low-complexity and generalized AI model that can capture common knowledge to improve data reconstruction of the channel decoder for semantic communication. Specifically, we propose a generative…

Semantic Communication