paper-with-me

Papers

Does Invariant Graph Learning via Environment Augmentation Learn Invariance?

2023-10-29 · NeurIPS 2023 11 · Yongqiang Chen, Yatao Bian, Kaiwen Zhou, Binghui Xie, Bo Han, James Cheng

Invariant graph representation learning aims to learn the invariance among data from different environments for out-of-distribution generalization on graphs. As the graph environment partitions are usually expensive to obtain, augmenting the environment information has become the de facto approach. However, the usefulness of the augmented environment information has never been verified. In this work, we find that it is fundamentally impossible to learn invariant graph representations via environment augmentation without additional assumptions. Therefore, we develop a set of minimal assumptions, including variation sufficiency and variation consistency, for feasible invariant graph learning. We then propose a new framework Graph invAriant Learning Assistant (GALA). GALA incorporates an assistant model that needs to be sensitive to graph environment changes or distribution shifts. The correctness of the proxy predictions by the assistant model hence can differentiate the variations in spurious subgraphs. We show that extracting the maximally invariant subgraph to the proxy predictions provably identifies the underlying invariant subgraph for successful OOD generalization under the established minimal assumptions. Extensive experiments on datasets including DrugOOD with various graph distribution shifts confirm the effectiveness of GALA.

📄 PDF Abstract BibTeX arXiv:2310.19035

Code (1)

lfhase/gala pytorch

Tasks

Graph LearningGraph Representation LearningOut-of-Distribution GeneralizationRepresentation Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
GALA Most attention mechanisms learn where to focus using only weak supervisory signals from class labels, which inspired Linsley et al. to investigate how explicit human supervision…

Similar Papers 제목 키워드 기반

Label-invariant Augmentation for Semi-Supervised Graph Classification

2022-05-19 · Han Yue, Chunhui Zhang, Chuxu Zhang, Hongfu Liu

Recently, contrastiveness-based augmentation surges a new climax in the computer vision domain, where some operations, including rotation, crop, and flip, combined with dedicated algorithms, dramatically increase the mod…

ClassificationContrastive LearningGraph ClassificationGraph Neural Network

Mind the Label Shift of Augmentation-based Graph OOD Generalization

2023-03-27 · CVPR 2023 1 · Junchi Yu, Jian Liang, Ran He

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalizati…

Unleashing the Power of Graph Data Augmentation on Covariate Distribution Shift

2022-11-05 · NeurIPS 2023 11 · Yongduo Sui, Qitian Wu, Jiancan Wu, Qing Cui 외

The issue of distribution shifts is emerging as a critical concern in graph representation learning. From the perspective of invariant learning and stable learning, a recently well-established paradigm for out-of-distrib…

Data AugmentationGraph ClassificationGraph Representation LearningOut-of-Distribution Generalization+1

diffIRM: A Diffusion-Augmented Invariant Risk Minimization Framework for Spatiotemporal Prediction over Graphs

2024-12-31 · Zhaobin Mo, Haotian Xiang, Xuan Di

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. T…

Data Augmentation

Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations

2022-10-15 · Haifeng Li, Jun Cao, Jiawei Zhu, Qinyao Luo 외

The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semant…

Contrastive LearningData AugmentationMutual Information EstimationNode Classification