Towards Fair Federated Learning with Zero-Shot Data Augmentation
Federated learning has emerged as an important distributed learning paradigm, where a server aggregates a global model from many client-trained models while having no access to the client data. Although it is recognized that statistical heterogeneity of the client local data yields slower global model convergence, it is less commonly recognized that it also yields a biased federated global model with a high variance of accuracy across clients. In this work, we aim to provide federated learning schemes with improved fairness. To tackle this challenge, we propose a novel federated learning system that employs zero-shot data augmentation on under-represented data to mitigate statistical heterogeneity and encourage more uniform accuracy performance across clients in federated networks. We study two variants of this scheme, Fed-ZDAC (federated learning with zero-shot data augmentation at the clients) and Fed-ZDAS (federated learning with zero-shot data augmentation at the server). Empirical results on a suite of datasets demonstrate the effectiveness of our methods on simultaneously improving the test accuracy and fairness.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFairnessFederated LearningSimilar Papers 제목 키워드 기반
Zero-Shot Decentralized Federated Learning
CLIP has revolutionized zero-shot learning by enabling task generalization without fine-tuning. While prompting techniques like CoOp and CoCoOp enhance CLIP's adaptability, their effectiveness in Federated Learning (FL) …
Image ClassificationFederated LearningZero-Shot LearningExploring Semantic Attributes from A Foundation Model for Federated Learning of Disjoint Label Spaces
Conventional centralised deep learning paradigms are not feasible when data from different sources cannot be shared due to data privacy or transmission limitation. To resolve this problem, federated learning has been int…
AttributeFederated LearningPrivacy PreservingTransfer Learning+1ReSLLM: Large Language Models are Strong Resource Selectors for Federated Search
Federated search, which involves integrating results from multiple independent search engines, will become increasingly pivotal in the context of Retrieval-Augmented Generation pipelines empowering LLM-based applications…
Retrieval-augmented GenerationFew-Shot Generation of Brain Tumors for Secure and Fair Data Sharing
Leveraging multi-center data for medical analytics presents challenges due to privacy concerns and data heterogeneity. While distributed approaches such as federated learning has gained traction, they remain vulnerable t…
Brain Tumor SegmentationData AugmentationFairnessFederated Learning+2Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement
With the increasing importance of data privacy and security, federated unlearning emerges as a new research field dedicated to ensuring that once specific data is deleted, federated learning models no longer retain or di…
Synthetic Data GenerationFederated Learning