paper-with-me

Papers

Unleashing the Power of Graph Data Augmentation on Covariate Distribution Shift

2022-11-05 · NeurIPS 2023 11 · Yongduo Sui, Qitian Wu, Jiancan Wu, Qing Cui, Longfei Li, Jun Zhou, Xiang Wang, Xiangnan He

The issue of distribution shifts is emerging as a critical concern in graph representation learning. From the perspective of invariant learning and stable learning, a recently well-established paradigm for out-of-distribution generalization, stable features of the graph are assumed to causally determine labels, while environmental features tend to be unstable and can lead to the two primary types of distribution shifts. The correlation shift is often caused by the spurious correlation between environmental features and labels that differs between the training and test data; the covariate shift often stems from the presence of new environmental features in test data. However, most strategies, such as invariant learning or graph augmentation, typically struggle with limited training environments or perturbed stable features, thus exposing limitations in handling the problem of covariate shift. To address this challenge, we propose a simple-yet-effective data augmentation strategy, Adversarial Invariant Augmentation (AIA), to handle the covariate shift on graphs. Specifically, given the training data, AIA aims to extrapolate and generate new environments, while concurrently preserving the original stable features during the augmentation process. Such a design equips the graph classification model with an enhanced capability to identify stable features in new environments, thereby effectively tackling the covariate shift in data. Extensive experiments with in-depth empirical analysis demonstrate the superiority of our approach. The implementation codes are publicly available at https://github.com/yongduosui/AIA.

📄 PDF Abstract BibTeX arXiv:2211.02843

Code (1)

yongduosui/aia 공식 구현 pytorch

Tasks

Data AugmentationGraph ClassificationGraph Representation LearningOut-of-Distribution GeneralizationRepresentation Learning

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Graph Data Augmentation with Contrastive Learning on Covariate Distribution Shift

2025-11-30 · Fanlong Zeng, Wensheng Gan arxiv

Covariate distribution shift occurs when certain structural features present in the test set are absent from the training set. It is a common type of out-of-distribution (OOD) problem, frequently encountered in real-worl…

Contrastive LearningData Augmentation

Mitigating Graph Covariate Shift via Score-based Out-of-distribution Augmentation

2024-10-23 · Bohan Wang, Yurui Chang, Lu Lin

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of…

Graph GenerationGraph Learning

RANK: Large-Scale Inference with Graphical Nonlinear Knockoffs

2017-08-31 · Yingying Fan, Emre Demirkaya, Gaorong Li, Jinchi Lv

Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this paper, we provide theoretical foundations on the …

GDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models

2024-10-23 · Zhixia He, Chen Zhao, Minglai Shao, Yujie Lin 외

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs pri…

Out of Distribution (OOD) Detection

Adversarial Label Invariant Graph Data Augmentations for Out-of-Distribution Generalization

2026-04-09 · Simon Zhang, Ryan P. DeMilt, Kun Jin, Cathy H. Xia arxiv

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate …

Representation LearningGraph Classification