FedPH: Privacy-enhanced Heterogeneous Federated Learning
Federated Learning is a distributed machine-learning environment that allows clients to learn collaboratively without sharing private data. This is accomplished by exchanging parameters. However, the differences in data distributions and computing resources among clients make related studies difficult. To address these heterogeneous problems, we propose a novel Federated Learning method. Our method utilizes a pre-trained model as the backbone of the local model, with fully connected layers comprising the head. The backbone extracts features for the head, and the embedding vector of classes is shared between clients to improve the head and enhance the performance of the local model. By sharing the embedding vector of classes instead of gradient-based parameters, clients can better adapt to private data, and communication between the server and clients is more effective. To protect privacy, we propose a privacy-preserving hybrid method that adds noise to the embedding vector of classes. This method has a minimal effect on the performance of the local model when differential privacy is met. We conduct a comprehensive evaluation of our approach on a self-built vehicle dataset, comparing it with other Federated Learning methods under non-independent identically distributed(Non-IID).
Code (1)
Tasks
Federated LearningPrivacy PreservingSimilar Papers 제목 키워드 기반
FedPhD: Federated Pruning with Hierarchical Learning of Diffusion Models
Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image ge…
Computational EfficiencyFederated LearningFedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning
Recently, Heterogeneous Federated Learning (HtFL) has attracted attention due to its ability to support heterogeneous models and data. To reduce the high communication cost of transmitting model parameters, a major chall…
Contrastive LearningFederated LearningThe Sandwich meta-framework for architecture agnostic deep privacy-preserving transfer learning for non-invasive brainwave decoding
Machine learning has enhanced the performance of decoding signals indicating human behaviour. EEG decoding, as an exemplar indicating neural activity and human thoughts non-invasively, has been helpful in neural activity…
EEGEeg DecodingFederated LearningMotor Imagery+2Developing Federated Time-to-Event Scores Using Heterogeneous Real-World Survival Data
Survival analysis serves as a fundamental component in numerous healthcare applications, where the determination of the time to specific events (such as the onset of a certain disease or death) for patients is crucial fo…
Privacy PreservingSurvival AnalysisAdvancing Personalized Federated Learning: Integrative Approaches with AI for Enhanced Privacy and Customization
In the age of data-driven decision making, preserving privacy while providing personalized experiences has become paramount. Personalized Federated Learning (PFL) offers a promising framework by decentralizing the learni…
Decision MakingFederated LearningPersonalized Federated LearningPrivacy Preserving+1