New Metrics to Evaluate the Performance and Fairness of Personalized Federated Learning

2021-07-28 · Siddharth Divi, Yi-Shan Lin, Habiba Farrukh, Z. Berkay Celik

In Federated Learning (FL), the clients learn a single global model (FedAvg) through a central aggregator. In this setting, the non-IID distribution of the data across clients restricts the global FL model from delivering good performance on the local data of each client. Personalized FL aims to address this problem by finding a personalized model for each client. Recent works widely report the average personalized model accuracy on a particular data split of a dataset to evaluate the effectiveness of their methods. However, considering the multitude of personalization approaches proposed, it is critical to study the per-user personalized accuracy and the accuracy improvements among users with an equitable notion of fairness. To address these issues, we present a set of performance and fairness metrics intending to assess the quality of personalized FL methods. We apply these metrics to four recently proposed personalized FL methods, PersFL, FedPer, pFedMe, and Per-FedAvg, on three different data splits of the CIFAR-10 dataset. Our evaluations show that the personalized model with the highest average accuracy across users may not necessarily be the fairest. Our code is available at https://tinyurl.com/1hp9ywfa for public use.

📄 PDF Abstract BibTeX arXiv:2107.13173

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness Federated Learning Personalized Federated Learning

Motley: Benchmarking Heterogeneity and Personalization in Federated Learning

2022-06-18 · Shanshan Wu, Tian Li, Zachary Charles, Yu Xiao 외

Personalized federated learning considers learning models unique to each client in a heterogeneous network. The resulting client-specific models have been purported to improve metrics such as accuracy, fairness, and robu…

Benchmarking Fairness Federated Learning Meta-Learning+3

Convergence-Privacy-Fairness Trade-Off in Personalized Federated Learning

2025-06-17 · Xiyu Zhao, Qimei Cui, Weicai Li, Wei Ni 외

Personalized federated learning (PFL), e.g., the renowned Ditto, strikes a balance between personalization and generalization by conducting federated learning (FL) to guide personalized learning (PL). While FL is unaffec…

Fairness Federated Learning Personalized Federated Learning

Towards Communication Efficient and Fair Federated Personalized Sequential Recommendation

2022-08-23 · Sichun Luo, Yuanzhang Xiao, Yang Liu, Congduan Li 외

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addre…

Fairness Federated Learning Privacy Preserving Recommendation Systems+1

Friends in Unexpected Places: Enhancing Local Fairness in Federated Learning through Clustering

2024-07-27 · Yifan Yang, Ali Payani, Parinaz Naghizadeh

Federated Learning (FL) has been a pivotal paradigm for collaborative training of machine learning models across distributed datasets. In heterogeneous settings, it has been observed that a single shared FL model can lea…

Clustering Fairness Federated Learning Personalized Federated Learning

pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learning

2026-06-15 · Zhuodong Liu, Xiangyu Li, Zhihao Zhang arxiv

Federated unlearning (FU) enables the removal of specific data contributions from federated learning (FL) models to comply with regulations such as the General Data Protection Regulation (GDPR). However, most existing FU…

Personalized Federated Learning