paper-with-me

Papers

Probabilistic Federated Learning on Uncertain and Heterogeneous Data with Model Personalization

2026-03-18 · Ratun Rahman, Dinh C. Nguyen arxiv

Conventional federated learning (FL) frameworks often suffer from training degradation due to data uncertainty and heterogeneity across local clients. Probabilistic approaches such as Bayesian neural networks (BNNs) can mitigate this issue by explicitly modeling uncertainty, but they introduce additional runtime, latency, and bandwidth overhead that has rarely been studied in federated settings. To address these challenges, we propose Meta-BayFL, a personalized probabilistic FL method that combines meta-learning with BNNs to improve training under uncertain and heterogeneous data. The framework is characterized by three main features: (1) BNN-based client models incorporate uncertainty across hidden layers to stabilize training on small and noisy datasets, (2) meta-learning with adaptive learning rates enables personalized updates that enhance local training under non-IID conditions, and (3) a unified probabilistic and personalized design improves the robustness of global model aggregation. We provide a theoretical convergence analysis and characterize the upper bound of the global model over communication rounds. In addition, we evaluate computational costs (runtime, latency, and communication) and discuss the feasibility of deployment on resource-constrained devices such as edge nodes and IoT systems. Extensive experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet show that Meta-BayFL consistently outperforms state-of-the-art methods, including both standard and personalized FL approaches (e.g., pFedMe, Ditto, FedFomo), with up to 7.42\% higher test accuracy.

📄 PDF Abstract BibTeX arXiv:2603.18083

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approach

2024-01-16 · Mahrokh Ghoddousi Boroujeni, Andreas Krause, Giancarlo Ferrari Trecate

Federated Learning (FL) aims to infer a shared model from private and decentralized data stored by multiple clients. Personalized FL (PFL) enhances the model's fit for each client by adapting the global model to the clie…

Federated LearningGeneralization BoundsPersonalized Federated Learning

Federated Short-Term Load Forecasting with Personalization Layers for Heterogeneous Clients

2023-09-22 · Shourya Bose, Kibaek Kim

The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting (STLF) models. In response to privacy concerns, federated learning (FL) has been proposed as…

Federated LearningLoad ForecastingPrivacy Preserving

Multi-Task Model Personalization for Federated Supervised SVM in Heterogeneous Networks

2023-03-17 · Aleksei Ponomarenko-Timofeev, Olga Galinina, Ravikumar Balakrishnan, Nageen Himayat 외

Federated systems enable collaborative training on highly heterogeneous data through model personalization, which can be facilitated by employing multi-task learning algorithms. However, significant variation in device c…

Multi-Task Learningregression

Bayesian Neural Network For Personalized Federated Learning Parameter Selection

2024-02-25 · Mengen Luo, Ercan Engin Kuruoglu

Federated learning's poor performance in the presence of heterogeneous data remains one of the most pressing issues in the field. Personalized federated learning departs from the conventional paradigm in which all client…

Federated LearningPersonalized Federated Learning

Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learning

2025-09-12 · Nour Jamoussi, Giuseppe Serra, Photios A. Stavrou, Marios Kountouris arxiv

Bayesian Federated Learning (BFL) combines uncertainty modeling with decentralized training, enabling the development of personalized and reliable models under data heterogeneity and privacy constraints. Existing approac…

Federated Learning