paper-with-me

홈 › Papers

Explaining and Adapting Graph Conditional Shift

2023-06-05 · Qi Zhu, Yizhu Jiao, Natalia Ponomareva, Jiawei Han, Bryan Perozzi

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why graph-based models seem more vulnerable to these shifts. In this work we provide a thorough theoretical analysis on it by quantifying the magnitude of conditional shift between the input features and the output label. Our findings show that both graph heterophily and model architecture exacerbate conditional shifts, leading to performance degradation. To address this, we propose an approach that involves estimating and minimizing the conditional shift for unsupervised domain adaptation on graphs. In our controlled synthetic experiments, our algorithm demonstrates robustness towards distribution shift, resulting in up to 10% absolute ROC AUC improvement versus the second-best algorithm. Furthermore, comprehensive experiments on both node classification and graph classification show its robust performance under various distribution shifts.

📄 PDF Abstract BibTeX arXiv:2306.03256

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGraph ClassificationNode ClassificationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

ShapShift: Explaining Model Prediction Shifts with Subgroup Conditional Shapley Values

2026-04-13 · Tom Bewley, Salim I. Amoukou, Emanuele Albini, Saumitra Mishra 외 arxiv

Changes in input distribution can induce shifts in the average predictions of machine learning models. Such prediction shifts may impact downstream business outcomes (e.g. a bank's loan approval rate), so understanding t…

A hierarchical decomposition for explaining ML performance discrepancies

2024-02-22 · Jean Feng, Harvineet Singh, Fan Xia, Adarsh Subbaswamy 외

Machine learning (ML) algorithms can often differ in performance across domains. Understanding $\textit{why}$ their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operati…

valid

Explaining Predictive Uncertainty with Information Theoretic Shapley Values

2023-09-21 · NeurIPS 2023 11

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of…

Active LearningDecision Making Under UncertaintyDepth Aleatoric Uncertainty EstimationExplainable Artificial Intelligence (XAI)+1

Learning Causal Models under Independent Changes

2023-09-21 · NeurIPS 2023 11

In many scientific applications, we observe a system in different conditions in which its components may change, rather than in isolation. In our work, we are interested in explaining the generating process of such a mul…

Conditional Shift-Robust Conformal Prediction for Graph Neural Network

2024-05-20 · S. Akansha

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertain…

Conformal PredictionGraph Neural NetworkNode ClassificationPrediction+1