paper-with-me

홈 › Papers

Invariant Structure Learning for Better Generalization and Causal Explainability

2022-06-13 · Yunhao Ge, Sercan Ö. Arik, Jinsung Yoon, Ao Xu, Laurent Itti, Tomas Pfister

Learning the causal structure behind data is invaluable for improving generalization and obtaining high-quality explanations. We propose a novel framework, Invariant Structure Learning (ISL), that is designed to improve causal structure discovery by utilizing generalization as an indication. ISL splits the data into different environments, and learns a structure that is invariant to the target across different environments by imposing a consistency constraint. An aggregation mechanism then selects the optimal classifier based on a graph structure that reflects the causal mechanisms in the data more accurately compared to the structures learnt from individual environments. Furthermore, we extend ISL to a self-supervised learning setting where accurate causal structure discovery does not rely on any labels. This self-supervised ISL utilizes invariant causality proposals by iteratively setting different nodes as targets. On synthetic and real-world datasets, we demonstrate that ISL accurately discovers the causal structure, outperforms alternative methods, and yields superior generalization for datasets with significant distribution shifts.

📄 PDF Abstract BibTeX arXiv:2206.06469

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

Diagnosing and Rectifying Fake OOD Invariance: A Restructured Causal Approach

2023-12-15 · Ziliang Chen, Yongsen Zheng, Zhao-Rong Lai, Quanlong Guan 외

Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization.…

feature selectionRepresentation Learning

A Causal Inspired Early-Branching Structure for Domain Generalization

2024-03-13 · Liang Chen, Yong Zhang, Yibing Song, Zhen Zhang 외

Learning domain-invariant semantic representations is crucial for achieving domain generalization (DG), where a model is required to perform well on unseen target domains. One critical challenge is that standard training…

Domain Generalization

Invariant Grounding for Video Question Answering

2022-06-06 · CVPR 2022 1 · Yicong Li, Xiang Wang, Junbin Xiao, Wei Ji 외

Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is understanding the alignments between visual scenes in video and linguistic semantics in question to yield the answer. In…

Question AnsweringVideo Question Answering

Continual Learning of Domain-Invariant Representations

2026-05-15 · Pascal Janetzky, Tobias Schlagenhauf, Stefan Feuerriegel arxiv

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to …

Representation LearningDomain GeneralizationContinual Learning

iDAG: Invariant DAG Searching for Domain Generalization

2023-01-01 · ICCV 2023 1 · Zenan Huang, Haobo Wang, Junbo Zhao, Nenggan Zheng

Existing machine learning (ML) models are often fragile in open environments because the data distribution frequently shifts. To address this problem, domain generalization (DG) aims to explore underlying invariant p…

Contrastive LearningDomain Generalization