Heterogeneous Federated Learning Systems for Time-Series Power Consumption Prediction with Multi-Head Embedding Mechanism
Time-series prediction is increasingly popular in a variety of applications, such as smart factories and smart transportation. Researchers have used various techniques to predict power consumption, but existing models lack discussion of collaborative learning and privacy issues among multiple clients. To address these issues, we propose Multi-Head Heterogeneous Federated Learning (MHHFL) systems that consist of multiple head networks, which independently act as carriers for federated learning. In the federated period, each head network is embedded into 2-dimensional vectors and shared with the centralized source pool. MHHFL then selects appropriate source networks and blends the head networks as knowledge transfer in federated learning. The experimental results show that the proposed MHHFL systems significantly outperform the benchmark and state-of-the-art systems and reduce the prediction error by 24.9% to 94.1%. The ablation studies demonstrate the effectiveness of the proposed mechanisms in the MHHFL (head network embedding and selection mechanisms), which significantly outperforms traditional federated average and random transfer.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningNetwork EmbeddingTime SeriesTime Series PredictionTransfer LearningSimilar Papers 제목 키워드 기반
Heterogeneous Federated Learning System for Sparse Healthcare Time-Series Prediction
In this paper, we propose a heterogeneous federated learning (HFL) system for sparse time series prediction in healthcare, which is a decentralized federated learning algorithm with heterogeneous transfers. We design den…
Federated LearningPredictionTime SeriesTime Series Prediction+1Improving accuracy and convergence of federated learning edge computing methods for generalized DER forecasting applications in power grid
This proposal aims to develop more accurate federated learning (FL) methods with faster convergence properties and lower communication requirements, specifically for forecasting distributed energy resources (DER) such as…
Edge-computingFederated LearningLoad ForecastingTime SeriesFederated Foundation Models on Heterogeneous Time Series
Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain t…
Anomaly DetectionFederated LearningImputationTime Series+1Progressive Size-Adaptive Federated Learning: A Comprehensive Framework for Heterogeneous Multi-Modal Data Systems
Federated Learning (FL) has emerged as a transformative paradigm for distributed machine learning while preserving data privacy. However, existing approaches predominantly focus on model heterogeneity and aggregation tec…
Federated LearningTime SeriesDeep Federated Anomaly Detection for Multivariate Time Series Data
Despite the fact that many anomaly detection approaches have been developed for multivariate time series data, limited effort has been made on federated settings in which multivariate time series data are heterogeneously…
Anomaly DetectionConstrained ClusteringFederated LearningTime Series+2