paper-with-me

Papers

Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency

2024-07-21 · Xuexin Chen, Ruichu Cai, Kaitao Zheng, Zhifan Jiang, Zhengting Huang, Zhifeng Hao, Zijian Li

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning the original and augmented data with the help of environment augmentation. However, these solutions might lead to the loss or redundancy of semantic subgraphs and result in suboptimal generalization. To address this challenge, we propose exploiting Probability of Necessity and Sufficiency (PNS) to extract sufficient and necessary invariant substructures. Beyond that, we further leverage the domain variant subgraphs related to the labels to boost the generalization performance in an ensemble manner. Specifically, we first consider the data generation process for graph data. Under mild conditions, we show that the sufficient and necessary invariant subgraph can be extracted by minimizing an upper bound, built on the theoretical advance of the probability of necessity and sufficiency. To further bridge the theory and algorithm, we devise the model called Sufficiency and Necessity Inspired Graph Learning (SNIGL), which ensembles an invariant subgraph classifier on top of latent sufficient and necessary invariant subgraphs, and a domain variant subgraph classifier specific to the test domain for generalization enhancement. Experimental results demonstrate that our SNIGL model outperforms the state-of-the-art techniques on six public benchmarks, highlighting its effectiveness in real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2407.15273

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Learning

Similar Papers 제목 키워드 기반

Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiency

2024-02-14 · Xuexin Chen, Ruichu Cai, Kaitao Zheng, Zhifan Jiang 외

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has a massive of real-world applications. One of the most mainstream methods is to extract the invariant s…

Graph Learning

Varifold Moment Invariants for Sustainable and Explainable Contour Feature Extraction

2026-06-05 · G. Longari, J. -C. Alvarez Paiva, A. B. Tumpach arxiv

We introduce Varifold Moments Invariants (VMI) as a unifying framework for many previously introduced Moment Invariants. These invariants are deeply related to other contour features that are invariant under translations…

Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization

2024-08-03 · Wenyu Mao, Jiancan Wu, Haoyang Liu, Yongduo Sui 외

Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under distribution shifts. Invariant learning…

Contrastive LearningData AugmentationGraph ClassificationGraph Learning+1

A Unifying Causal Framework for Analyzing Dataset Shift-stable Learning Algorithms

2019-05-27 · Adarsh Subbaswamy, Bryant Chen, Suchi Saria

Recent interest in the external validity of prediction models (i.e., the problem of different train and test distributions, known as dataset shift) has produced many methods for finding predictive distributions that are …

A Unified Invariant Learning Framework for Graph Classification

2025-01-22 · Yongduo Sui, Jie Sun, Shuyao Wang, Zemin Liu 외

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classific…

ClassificationGraph ClassificationGraph Learning