Multi-Task Model Personalization for Federated Supervised SVM in Heterogeneous Networks
Federated systems enable collaborative training on highly heterogeneous data through model personalization, which can be facilitated by employing multi-task learning algorithms. However, significant variation in device computing capabilities may result in substantial degradation in the convergence rate of training. To accelerate the learning procedure for diverse participants in a multi-task federated setting, more efficient and robust methods need to be developed. In this paper, we design an efficient iterative distributed method based on the alternating direction method of multipliers (ADMM) for support vector machines (SVMs), which tackles federated classification and regression. The proposed method utilizes efficient computations and model exchange in a network of heterogeneous nodes and allows personalization of the learning model in the presence of non-i.i.d. data. To further enhance privacy, we introduce a random mask procedure that helps avoid data inversion. Finally, we analyze the impact of the proposed privacy mechanisms and participant hardware and data heterogeneity on the system performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task LearningregressionSimilar Papers 제목 키워드 기반
Federated Short-Term Load Forecasting with Personalization Layers for Heterogeneous Clients
The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting (STLF) models. In response to privacy concerns, federated learning (FL) has been proposed as…
Federated LearningLoad ForecastingPrivacy PreservingpFedAFM: Adaptive Feature Mixture for Batch-Level Personalization in Heterogeneous Federated Learning
Model-heterogeneous personalized federated learning (MHPFL) enables FL clients to train structurally different personalized models on non-independent and identically distributed (non-IID) local data. Existing MHPFL metho…
Federated LearningPersonalized Federated LearningPredictionMotley: Benchmarking Heterogeneity and Personalization in Federated Learning
Personalized federated learning considers learning models unique to each client in a heterogeneous network. The resulting client-specific models have been purported to improve metrics such as accuracy, fairness, and robu…
BenchmarkingFairnessFederated LearningMeta-Learning+3FedMOA: Federated GRPO for Personalized Reasoning LLMs under Heterogeneous Rewards
Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While perso…
Reinforcement LearningMathematical ReasoningFederated LearningCode GenerationFederated Unsupervised Visual Representation Learning via Exploiting General Content and Personal Style
Discriminative unsupervised learning methods such as contrastive learning have demonstrated the ability to learn generalized visual representations on centralized data. It is nonetheless challenging to adapt such methods…
Contrastive LearningFederated LearningRepresentation Learning