paper-with-me

홈 › Papers

Stable Prediction on Graphs with Agnostic Distribution Shift

2021-10-08 · Shengyu Zhang, Kun Kuang, Jiezhong Qiu, Jin Yu, Zhou Zhao, Hongxia Yang, Zhongfei Zhang, Fei Wu

Graph is a flexible and effective tool to represent complex structures in practice and graph neural networks (GNNs) have been shown to be effective on various graph tasks with randomly separated training and testing data. In real applications, however, the distribution of training graph might be different from that of the test one (e.g., users' interactions on the user-item training graph and their actual preference on items, i.e., testing environment, are known to have inconsistencies in recommender systems). Moreover, the distribution of test data is always agnostic when GNNs are trained. Hence, we are facing the agnostic distribution shift between training and testing on graph learning, which would lead to unstable inference of traditional GNNs across different test environments. To address this problem, we propose a novel stable prediction framework for GNNs, which permits both locally and globally stable learning and prediction on graphs. In particular, since each node is partially represented by its neighbors in GNNs, we propose to capture the stable properties for each node (locally stable) by re-weighting the information propagation/aggregation processes. For global stability, we propose a stable regularizer that reduces the training losses on heterogeneous environments and thus warping the GNNs to generalize well. We conduct extensive experiments on several graph benchmarks and a noisy industrial recommendation dataset that is collected from 5 consecutive days during a product promotion festival. The results demonstrate that our method outperforms various SOTA GNNs for stable prediction on graphs with agnostic distribution shift, including shift caused by node labels and attributes.

📄 PDF Abstract BibTeX arXiv:2110.03865

Code (0)

등록된 구현이 없습니다.

Tasks

Graph LearningPredictionRecommendation Systems

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Prediction with Incomplete Data under Agnostic Mask Distribution Shift

2023-05-18 · Yichen Zhu, Jian Yuan, Bo Jiang, Tao Lin 외

Data with missing values is ubiquitous in many applications. Recent years have witnessed increasing attention on prediction with only incomplete data consisting of observed features and a mask that indicates the missing …

Missing ValuesPrediction

Out-of-Distribution Generalized Dynamic Graph Neural Network with Disentangled Intervention and Invariance Promotion

2023-11-24 · Zeyang Zhang, Xin Wang, Ziwei Zhang, Haoyang Li 외

Dynamic graph neural networks (DyGNNs) have demonstrated powerful predictive abilities by exploiting graph structural and temporal dynamics. However, the existing DyGNNs fail to handle distribution shifts, which naturall…

Graph AttentionGraph Neural Network

Balance-Subsampled Stable Prediction

2020-06-08 · Kun Kuang, Hengtao Zhang, Fei Wu, Yueting Zhuang 외

In machine learning, it is commonly assumed that training and test data share the same population distribution. However, this assumption is often violated in practice because the sample selection bias may induce the dist…

parameter estimationPredictionSelection bias

Causal-aware Graph Neural Architecture Search under Distribution Shifts

2024-05-26 · Peiwen Li, Xin Wang, Zeyang Zhang, Yijian Qin 외

Graph NAS has emerged as a promising approach for autonomously designing GNN architectures by leveraging the correlations between graphs and architectures. Existing methods fail to generalize under distribution shifts th…

Graph EmbeddingNeural Architecture SearchOut-of-Distribution Generalization

Generalizing Graph Neural Networks on Out-Of-Distribution Graphs

2021-11-20 · Shaohua Fan, Xiao Wang, Chuan Shi, Peng Cui 외

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (…

Causal Inference