Federated Reconstruction: Partially Local Federated Learning
Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all model parameters can be undesirable due to privacy and communication constraints. Other approaches require always-available or stateful clients, impractical in large-scale cross-device settings. We introduce Federated Reconstruction, the first model-agnostic framework for partially local federated learning suitable for training and inference at scale. We motivate the framework via a connection to model-agnostic meta learning, empirically demonstrate its performance over existing approaches for collaborative filtering and next word prediction, and release an open-source library for evaluating approaches in this setting. We also describe the successful deployment of this approach at scale for federated collaborative filtering in a mobile keyboard application.
Code (3)
Tasks
Collaborative FilteringFederated LearningMeta-LearningSimilar Papers 제목 키워드 기반
Federated Random Forest for Partially Overlapping Clinical Data
In the healthcare sector, a consciousness surrounding data privacy and corresponding data protection regulations, as well as heterogeneous and non-harmonized data, pose huge challenges to large-scale data analysis. Moreo…
DiagnosticLearning Federated Visual Prompt in Null Space for MRI Reconstruction
Federated Magnetic Resonance Imaging (MRI) reconstruction enables multiple hospitals to collaborate distributedly without aggregating local data, thereby protecting patient privacy. However, the data heterogeneity caused…
MRI ReconstructionLocal Model Reconstruction Attacks in Federated Learning and their Uses
In this paper, we initiate the study of local model reconstruction attacks for federated learning, where a honest-but-curious adversary eavesdrops the messages exchanged between a targeted client and the server, and then…
AttributeEarnings ClassificationFederated LearningInference Attack+2FederatedRSF : Federated Random Survival Forests for Partially Overlapping Medical Data
Multi-center survival prediction can improve robustness and generalizability, yet privacy regulations and institutional governance often prevent pooling patient-level clinical and genomic data across institutions. In pra…
Comparative assessment of federated and centralized machine learning
Federated Learning (FL) is a privacy preserving machine learning scheme, where training happens with data federated across devices and not leaving them to sustain user privacy. This is ensured by making the untrained or …
BIG-bench Machine LearningFederated LearningPrivacy Preserving