paper-with-me

홈 › Papers

Decoupled Self-supervised Learning for Non-Homophilous Graphs

2022-06-07 · Teng Xiao, Zhengyu Chen, Zhimeng Guo, Zeyang Zhuang, Suhang Wang

This paper studies the problem of conducting self-supervised learning for node representation learning on graphs. Most existing self-supervised learning methods assume the graph is homophilous, where linked nodes often belong to the same class or have similar features. However, such assumptions of homophily do not always hold in real-world graphs. We address this problem by developing a decoupled self-supervised learning (DSSL) framework for graph neural networks. DSSL imitates a generative process of nodes and links from latent variable modeling of the semantic structure, which decouples different underlying semantics between different neighborhoods into the self-supervised learning process. Our DSSL framework is agnostic to the encoders and does not need prefabricated augmentations, thus is flexible to different graphs. To effectively optimize the framework, we derive the evidence lower bound of the self-supervised objective and develop a scalable training algorithm with variational inference. We provide a theoretical analysis to justify that DSSL enjoys the better downstream performance. Extensive experiments on various types of graph benchmarks demonstrate that our proposed framework can achieve better performance compared with competitive baselines.

📄 PDF Abstract BibTeX arXiv:2206.03601

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningSelf-Supervised LearningVariational Inference

Similar Papers 제목 키워드 기반

Discovering Invariant Neighborhood Patterns for Heterophilic Graphs

2024-03-15 · Ruihao Zhang, Zhengyu Chen, Teng Xiao, Yueyang Wang 외

This paper studies the problem of distribution shifts on non-homophilous graphs Mosting existing graph neural network methods rely on the homophilous assumption that nodes from the same class are more likely to be linked…

Graph LearningGraph Neural Network

When Contrastive Learning Meets Active Learning: A Novel Graph Active Learning Paradigm with Self-Supervision

2020-10-30 · Yanqiao Zhu, Weizhi Xu, Qiang Liu, Shu Wu

This paper studies active learning (AL) on graphs, whose purpose is to discover the most informative nodes to maximize the performance of graph neural networks (GNNs). Previously, most graph AL methods focus on learning …

Active LearningContrastive LearningGraph Representation LearningInformativeness+1

Mixture of Decoupled Message Passing Experts with Entropy Constraint for General Node Classification

2025-02-12 · Xuanze Chen, Jiajun Zhou, Jinsong Chen, Shanqing Yu 외

The varying degrees of homophily and heterophily in real-world graphs persistently constrain the universality of graph neural networks (GNNs) for node classification. Adopting a data-centric perspective, this work reveal…

Mixture-of-ExpertsNode ClassificationRepresentation Learning

GLINKX: A Scalable Unified Framework For Homophilous and Heterophilous Graphs

2022-11-01 · Marios Papachristou, Rishab Goel, Frank Portman, Matthew Miller 외

In graph learning, there have been two predominant inductive biases regarding graph-inspired architectures: On the one hand, higher-order interactions and message passing work well on homophilous graphs and are leveraged…

Graph LearningKnowledge Graph Embeddings

Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

2021-10-27 · NeurIPS 2021 12 · Derek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang 외

Many widely used datasets for graph machine learning tasks have generally been homophilous, where nodes with similar labels connect to each other. Recently, new Graph Neural Networks (GNNs) have been developed that move …

Graph LearningNode ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs