paper-with-me

홈 › Papers

FedPAE: Peer-Adaptive Ensemble Learning for Asynchronous and Model-Heterogeneous Federated Learning

2024-10-17 · Brianna Mueller, W. Nick Street, Stephen Baek, Qihang Lin, Jingyi Yang, Yankun Huang

Federated learning (FL) enables multiple clients with distributed data sources to collaboratively train a shared model without compromising data privacy. However, existing FL paradigms face challenges due to heterogeneity in client data distributions and system capabilities. Personalized federated learning (pFL) has been proposed to mitigate these problems, but often requires a shared model architecture and a central entity for parameter aggregation, resulting in scalability and communication issues. More recently, model-heterogeneous FL has gained attention due to its ability to support diverse client models, but existing methods are limited by their dependence on a centralized framework, synchronized training, and publicly available datasets. To address these limitations, we introduce Federated Peer-Adaptive Ensemble Learning (FedPAE), a fully decentralized pFL algorithm that supports model heterogeneity and asynchronous learning. Our approach utilizes a peer-to-peer model sharing mechanism and ensemble selection to achieve a more refined balance between local and global information. Experimental results show that FedPAE outperforms existing state-of-the-art pFL algorithms, effectively managing diverse client capabilities and demonstrating robustness against statistical heterogeneity.

📄 PDF Abstract BibTeX arXiv:2410.14075

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble LearningFederated LearningPersonalized Federated Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach

2026-05-24 · Jiahui Bai, Hai Dong, A. K. Qin arxiv

Asynchronous decentralized federated learning (ADFL) eliminates central coordination and global synchronization, making it attractive for large-scale and heterogeneous systems. However, frequent peer-to-peer communicatio…

Federated Learning

Stochastic convergence of parallel asynchronous adaptive first-order methods

2026-06-01 · Serge Gratton, Philippe L. Toint arxiv

A new class of asynchronous adaptive first-order optimization methods is introduced, comprising asynchronous variants of several popular algorithms. Versions of these methods using momentum and/or inexact normalization a…

FedDES: Graph-Based Dynamic Ensemble Selection for Personalized Federated Learning

2026-03-30 · Brianna Mueller, W. Nick Street arxiv

Statistical heterogeneity in Federated Learning (FL) often leads to negative transfer, where a single global model fails to serve diverse client distributions. Personalized federated learning (pFL) aims to address this b…

Personalized Federated LearningGraph Neural Network

Collaborative Deep Reinforcement Learning

2017-02-19 · Kaixiang Lin, Shu Wang, Jiayu Zhou

Besides independent learning, human learning process is highly improved by summarizing what has been learned, communicating it with peers, and subsequently fusing knowledge from different sources to assist the current le…

Deep Reinforcement LearningKnowledge DistillationOpenAI Gymreinforcement-learning+3

Mitigating Persistent Client Dropout in Asynchronous Decentralized Federated Learning

2025-08-03 · Ignacy Stępka, Nicholas Gisolfi, Kacper Trębacz, Artur Dubrawski arxiv

We consider the problem of persistent client dropout in asynchronous Decentralized Federated Learning (DFL). Asynchronicity and decentralization obfuscate information about model updates among federation peers, making re…

Federated Learning