OpenFGL: A Comprehensive Benchmark for Federated Graph Learning
Federated graph learning (FGL) is a promising distributed training paradigm for graph neural networks across multiple local systems without direct data sharing. This approach inherently involves large-scale distributed graph processing, which closely aligns with the challenges and research focuses of graph-based data systems. Despite the proliferation of FGL, the diverse motivations from real-world applications, spanning various research backgrounds and settings, pose a significant challenge to fair evaluation. To fill this gap, we propose OpenFGL, a unified benchmark designed for the primary FGL scenarios: Graph-FL and Subgraph-FL. Specifically, OpenFGL includes 42 graph datasets from 18 application domains, 8 federated data simulation strategies that emphasize different graph properties, and 5 graph-based downstream tasks. Additionally, it offers 18 recently proposed SOTA FGL algorithms through a user-friendly API, enabling a thorough comparison and comprehensive evaluation of their effectiveness, robustness, and efficiency. Our empirical results demonstrate the capabilities of FGL while also highlighting its potential limitations, providing valuable insights for future research in this growing field, particularly in fostering greater interdisciplinary collaboration between FGL and data systems.
Code (1)
Tasks
Graph LearningSimilar Papers 제목 키워드 기반
MM-OpenFGL: A Comprehensive Benchmark for Multimodal Federated Graph Learning
Multimodal-attributed graphs (MMAGs) provide a unified framework for modeling complex relational data by integrating heterogeneous modalities with graph structures. While centralized learning has shown promising performa…
Graph LearningBkd-FedGNN: A Benchmark for Classification Backdoor Attacks on Federated Graph Neural Network
Federated Graph Neural Network (FedGNN) has recently emerged as a rapidly growing research topic, as it integrates the strengths of graph neural networks and federated learning to enable advanced machine learning applica…
Backdoor AttackFederated LearningGraph Neural NetworkFedGraph: A Research Library and Benchmark for Federated Graph Learning
Federated graph learning is an emerging field with significant practical challenges. While algorithms have been proposed to improve the accuracy of training graph neural networks, such as node classification on federated…
BenchmarkingFederated LearningGraph LearningNode ClassificationFedNoisy: Federated Noisy Label Learning Benchmark
Federated learning has gained popularity for distributed learning without aggregating sensitive data from clients. But meanwhile, the distributed and isolated nature of data isolation may be complicated by data quality, …
Federated LearningLearning with noisy labelsFederated Learning for Medical Image Classification: A Comprehensive Benchmark
The federated learning paradigm is wellsuited for the field of medical image analysis, as it can effectively cope with machine learning on isolated multicenter data while protecting the privacy of participating parties. …
Computational EfficiencyDenoisingFederated Learningimage-classification+3