paper-with-me

홈 › Papers

Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approach

2024-04-04 · Qingxiang Liu, Sheng Sun, Yuxuan Liang, Jingjing Xue, Min Liu

The existing federated learning (FL) methods for spatio-temporal forecasting fail to capture the inherent spatio-temporal heterogeneity, which calls for personalized FL (PFL) methods to model the spatio-temporally variant patterns. While contrastive learning approach is promising in addressing spatio-temporal heterogeneity, the existing methods are noneffective in determining negative pairs and can hardly apply to PFL paradigm. To tackle this limitation, we propose a novel PFL method, named Federated dUal sEmantic aLignment-based contraStive learning (FUELS), which can adaptively align positive and negative pairs based on semantic similarity, thereby injecting precise spatio-temporal heterogeneity into the latent representation space by auxiliary contrastive tasks. From temporal perspective, a hard negative filtering module is introduced to dynamically align heterogeneous temporal representations for the supplemented intra-client contrastive task. From spatial perspective, we design lightweight-but-efficient prototypes as client-level semantic representations, based on which the server evaluates spatial similarity and yields client-customized global prototypes for the supplemented inter-client contrastive task. Extensive experiments demonstrate that FUELS outperforms state-of-the-art methods, with communication cost decreasing by around 94%.

📄 PDF Abstract BibTeX arXiv:2404.03702

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFederated LearningPersonalized Federated LearningSemantic SimilaritySemantic Textual SimilaritySpatio-Temporal Forecasting

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

HSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting

2024-09-27 · Shuowei Cai, Hao liu

Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the pe…

energy managementFederated LearningRepresentation LearningTime Series+1

Cross-Node Federated Graph Neural Network for Spatio-Temporal Data Modeling

2021-06-09 · Chuizheng Meng, Sirisha Rambhatla, Yan Liu

Vast amount of data generated from networks of sensors, wearables, and the Internet of Things (IoT) devices underscores the need for advanced modeling techniques that leverage the spatio-temporal structure of decentraliz…

Federated LearningGraph Neural NetworkInductive LearningSpatio-Temporal Forecasting

Federated Dynamic Modeling and Learning for Spatiotemporal Data Forecasting

2025-03-06 · Thien Pham, Angelo Furno, Faïcel Chamroukhi, Latifa Oukhellou

This paper presents an advanced Federated Learning (FL) framework for forecasting complex spatiotemporal data, improving upon recent state-of-the-art models. In the proposed approach, the original Gated Recurrent Unit (G…

Demand ForecastingFederated LearningPrivacy Preserving

MoE Enhanced Federated Learning for Spatiotemporal Prediction

2026-06-09 · Zhehao Dai, Xiao Han, Zhaolin Deng, Zijian Zhang 외 arxiv

Traffic prediction is fundamental to intelligent transportation systems and urban computing, yet many cities continue to suffer from traffic data scarcity due to limited sensor deployment and uneven urban development. Cr…

Federated LearningTraffic Prediction

Online Spatio-Temporal Correlation-Based Federated Learning for Traffic Flow Forecasting

2023-02-17 · Qingxiang Liu, Sheng Sun, Min Liu, Yuwei Wang 외

Traffic flow forecasting (TFF) is of great importance to the construction of Intelligent Transportation Systems (ITS). To mitigate communication burden and tackle with the problem of privacy leakage aroused by centralize…

Federated LearningGraph Attention