Towards Fairness in Provably Communication-Efficient Federated Recommender Systems

2024-05-03 · Kirandeep Kaur, Sujit Gujar, Shweta Jain

To reduce the communication overhead caused by parallel training of multiple clients, various federated learning (FL) techniques use random client sampling. Nonetheless, ensuring the efficacy of random sampling and determining the optimal number of clients to sample in federated recommender systems (FRSs) remains challenging due to the isolated nature of each user as a separate client. This challenge is exacerbated in models where public and private features can be separated, and FL allows communication of only public features (item gradients). In this study, we establish sample complexity bounds that dictate the ideal number of clients required for improved communication efficiency and retained accuracy in such models. In line with our theoretical findings, we empirically demonstrate that RS-FairFRS reduces communication cost (~47%). Second, we demonstrate the presence of class imbalance among clients that raises a substantial equity concern for FRSs. Unlike centralized machine learning, clients in FRS can not share raw data, including sensitive attributes. For this, we introduce RS-FairFRS, first fairness under unawareness FRS built upon random sampling based FRS. While random sampling improves communication efficiency, we propose a novel two-phase dual-fair update technique to achieve fairness without revealing protected attributes of active clients participating in training. Our results on real-world datasets and different sensitive features illustrate a significant reduction in demographic bias (~approx40\%), offering a promising path to achieving fairness and communication efficiency in FRSs without compromising the overall accuracy of FRS.

📄 PDF Abstract BibTeX arXiv:2405.15788

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness Federated Learning Recommendation Systems

Towards Communication Efficient and Fair Federated Personalized Sequential Recommendation

2022-08-23 · Sichun Luo, Yuanzhang Xiao, Yang Liu, Congduan Li 외

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addre…

Fairness Federated Learning Privacy Preserving Recommendation Systems+1

Fair and efficient contribution valuation for vertical federated learning

2022-01-07 · Zhenan Fan, Huang Fang, Zirui Zhou, Jian Pei 외

Federated learning is a popular technology for training machine learning models on distributed data sources without sharing data. Vertical federated learning or feature-based federated learning applies to the cases that …

Fairness Federated Learning Vertical Federated Learning

Towards Fair Federated Recommendation Learning: Characterizing the Inter-Dependence of System and Data Heterogeneity

2022-05-30 · Kiwan Maeng, Haiyu Lu, Luca Melis, John Nguyen 외

Federated learning (FL) is an effective mechanism for data privacy in recommender systems by running machine learning model training on-device. While prior FL optimizations tackled the data and system heterogeneity chall…

Fairness Federated Learning Model Optimization Recommendation Systems

Practical and Secure Federated Recommendation with Personalized Masks

2021-08-18 · Liu Yang, Junxue Zhang, Di Chai, Leye Wang 외

Federated recommendation addresses the data silo and privacy problems altogether for recommender systems. Current federated recommender systems mainly utilize cryptographic or obfuscation methods to protect the original …

Federated Learning Recommendation Systems

Fair Federated Learning via Bounded Group Loss

2022-03-18 · Shengyuan Hu, Zhiwei Steven Wu, Virginia Smith

Fair prediction across protected groups is an important constraint for many federated learning applications. However, prior work studying group fair federated learning lacks formal convergence or fairness guarantees. In …

Fairness Federated Learning