GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignment
Graph self-supervised learning (SSL) holds considerable promise for mining and learning with graph-structured data. Yet, a significant challenge in graph SSL lies in the feature discrepancy among graphs across different domains. In this work, we aim to pretrain one graph neural network (GNN) on a varied collection of graphs endowed with rich node features and subsequently apply the pretrained GNN to unseen graphs. We present a general GraphAlign method that can be seamlessly integrated into the existing graph SSL framework. To align feature distributions across disparate graphs, GraphAlign designs alignment strategies of feature encoding, normalization, alongside a mixture-of-feature-expert module. Extensive experiments show that GraphAlign empowers existing graph SSL frameworks to pretrain a unified and powerful GNN across multiple graphs, showcasing performance superiority on both in-domain and out-of-domain graphs.
Code (1)
Tasks
Graph Neural NetworkSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GraphAlign: Enhancing Accurate Feature Alignment by Graph matching for Multi-Modal 3D Object Detection
LiDAR and cameras are complementary sensors for 3D object detection in autonomous driving. However, it is challenging to explore the unnatural interaction between point clouds and images, and the critical factor is how t…
3D Object DetectionAutonomous DrivingGraph Matchingobject-detection+2Can Modifying Data Address Graph Domain Adaptation?
Graph neural networks (GNNs) have demonstrated remarkable success in numerous graph analytical tasks. Yet, their effectiveness is often compromised in real-world scenarios due to distribution shifts, limiting their capac…
Domain AdaptationGRAPH DOMAIN ADAPTATIONTransfer LearningGraph Context Encoder: Graph Feature Inpainting for Graph Generation and Self-supervised Pretraining
We propose the Graph Context Encoder (GCE), a simple but efficient approach for graph representation learning based on graph feature masking and reconstruction. GCE models are trained to efficiently reconstruct input gra…
Graph GenerationGraph Representation LearningRepresentation LearningFrom Node to Graph: Joint Reasoning on Visual-Semantic Relational Graph for Zero-Shot Detection
Zero-Shot Detection (ZSD), which aims at localizing andrecognizing unseen objects in a complicated scene, usuallyleverages the visual and semantic information of individ-ual objects alone. However, scene und…
Generalized Zero-Shot Object DetectionScene UnderstandingZero-Shot Object DetectionFragment-based Pretraining and Finetuning on Molecular Graphs
Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning fo…
Contrastive LearningProperty PredictionSelf-Supervised Learning