Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approach
The existing federated learning (FL) methods for spatio-temporal forecasting fail to capture the inherent spatio-temporal heterogeneity, which calls for personalized FL (PFL) methods to model the spatio-temporally variant patterns. While contrastive learning approach is promising in addressing spatio-temporal heterogeneity, the existing methods are noneffective in determining negative pairs and can hardly apply to PFL paradigm. To tackle this limitation, we propose a novel PFL method, named Federated dUal sEmantic aLignment-based contraStive learning (FUELS), which can adaptively align positive and negative pairs based on semantic similarity, thereby injecting precise spatio-temporal heterogeneity into the latent representation space by auxiliary contrastive tasks. From temporal perspective, a hard negative filtering module is introduced to dynamically align heterogeneous temporal representations for the supplemented intra-client contrastive task. From spatial perspective, we design lightweight-but-efficient prototypes as client-level semantic representations, based on which the server evaluates spatial similarity and yields client-customized global prototypes for the supplemented inter-client contrastive task. Extensive experiments demonstrate that FUELS outperforms state-of-the-art methods, with communication cost decreasing by around 94%.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningFederated LearningPersonalized Federated LearningSemantic SimilaritySemantic Textual SimilaritySpatio-Temporal ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting
Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the pe…
energy managementFederated LearningRepresentation LearningTime Series+1Cross-Node Federated Graph Neural Network for Spatio-Temporal Data Modeling
Vast amount of data generated from networks of sensors, wearables, and the Internet of Things (IoT) devices underscores the need for advanced modeling techniques that leverage the spatio-temporal structure of decentraliz…
Federated LearningGraph Neural NetworkInductive LearningSpatio-Temporal ForecastingFederated Dynamic Modeling and Learning for Spatiotemporal Data Forecasting
This paper presents an advanced Federated Learning (FL) framework for forecasting complex spatiotemporal data, improving upon recent state-of-the-art models. In the proposed approach, the original Gated Recurrent Unit (G…
Demand ForecastingFederated LearningPrivacy PreservingMoE Enhanced Federated Learning for Spatiotemporal Prediction
Traffic prediction is fundamental to intelligent transportation systems and urban computing, yet many cities continue to suffer from traffic data scarcity due to limited sensor deployment and uneven urban development. Cr…
Federated LearningTraffic PredictionOnline Spatio-Temporal Correlation-Based Federated Learning for Traffic Flow Forecasting
Traffic flow forecasting (TFF) is of great importance to the construction of Intelligent Transportation Systems (ITS). To mitigate communication burden and tackle with the problem of privacy leakage aroused by centralize…
Federated LearningGraph Attention