paper-with-me

홈 › Papers

Mitigating Graph Covariate Shift via Score-based Out-of-distribution Augmentation

2024-10-23 · Bohan Wang, Yurui Chang, Lu Lin

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally associated with labels, whereas varying environmental features lead to distribution shifts. In particular, covariate shifts caused by unseen environments in test graphs underscore the critical need for out-of-distribution (OOD) generalization. Existing graph augmentation methods designed to address the covariate shift often disentangle the stable and environmental features in the input space, and selectively perturb or mixup the environmental features. However, such perturbation-based methods heavily rely on an accurate separation of stable and environmental features, and their exploration ability is confined to existing environmental features in the training distribution. To overcome these limitations, we introduce a novel approach using score-based graph generation strategies that synthesize unseen environmental features while preserving the validity and stable features of overall graph patterns. Our comprehensive empirical evaluations demonstrate the enhanced effectiveness of our method in improving graph OOD generalization.

📄 PDF Abstract BibTeX arXiv:2410.17506

Code (0)

등록된 구현이 없습니다.

Tasks

Graph GenerationGraph Learning

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

GDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models

2024-10-23 · Zhixia He, Chen Zhao, Minglai Shao, Yujie Lin 외

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs pri…

Out of Distribution (OOD) Detection

Mitigating Both Covariate and Conditional Shift for Domain Generalization

2022-09-17 · Jianxin Lin, Yongqiang Tang, JunPing Wang, Wensheng Zhang

Domain generalization (DG) aims to learn a model on several source domains, hoping that the model can generalize well to unseen target domains. The distribution shift between domains contains the covariate shift and cond…

Domain Generalization

Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data

2021-10-28 · Junjiao Tian, Yen-Change Hsu, Yilin Shen, Hongxia Jin 외

Moving beyond testing on in-distribution data works on Out-of-Distribution (OOD) detection have recently increased in popularity. A recent attempt to categorize OOD data introduces the concept of near and far OOD detecti…

Out of Distribution (OOD) DetectionSensitivity

Exploring Covariate and Concept Shift for Detection and Confidence Calibration of Out-of-Distribution Data

2021-09-29 · Junjiao Tian, Yen-Chang Hsu, Yilin Shen, Hongxia Jin 외

Moving beyond testing on in-distribution data, works on Out-of-Distribution (OOD) detection have recently increased in popularity. A recent attempt to categorize OOD data introduces the concept of near and far OOD detect…

Out of Distribution (OOD) DetectionSensitivity

FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and Detection

2024-10-15 · Xinting Liao, Weiming Liu, Pengyang Zhou, Fengyuan Yu 외

Federated learning (FL) is a promising machine learning paradigm that collaborates with client models to capture global knowledge. However, deploying FL models in real-world scenarios remains unreliable due to the coexis…

Federated LearningOut-of-Distribution Generalization