On Bridging Generic and Personalized Federated Learning for Image Classification
Federated learning is promising for its capability to collaboratively train models with multiple clients without accessing their data, but vulnerable when clients' data distributions diverge from each other. This divergence further leads to a dilemma: "Should we prioritize the learned model's generic performance (for future use at the server) or its personalized performance (for each client)?" These two, seemingly competing goals have divided the community to focus on one or the other, yet in this paper we show that it is possible to approach both at the same time. Concretely, we propose a novel federated learning framework that explicitly decouples a model's dual duties with two prediction tasks. On the one hand, we introduce a family of losses that are robust to non-identical class distributions, enabling clients to train a generic predictor with a consistent objective across them. On the other hand, we formulate the personalized predictor as a lightweight adaptive module that is learned to minimize each client's empirical risk on top of the generic predictor. With this two-loss, two-predictor framework which we name Federated Robust Decoupling (Fed-RoD), the learned model can simultaneously achieve state-of-the-art generic and personalized performance, essentially bridging the two tasks.
Code (3)
Tasks
ClassificationFederated Learningimage-classificationImage ClassificationPersonalized Federated LearningSimilar Papers 제목 키워드 기반
Personalized Semantics Excitation for Federated Image Classification
Federated learning casts a light on the collaboration of distributed local clients with privacy protected to attain a more generic global model. However, significant distribution shift in input/label space across dif…
ClassificationFederated Learningimage-classificationImage Classification+2Personalized Quantum Federated Learning for Privacy Image Classification
Quantum federated learning has brought about the improvement of privacy image classification, while the lack of personality of the client model may contribute to the suboptimal of quantum federated learning. A personaliz…
ClassificationFederated Learningimage-classificationImage Classification+1FedABC: Targeting Fair Competition in Personalized Federated Learning
Federated learning aims to collaboratively train models without accessing their client's local private data. The data may be Non-IID for different clients and thus resulting in poor performance. Recently, personalized fe…
Binary ClassificationFederated LearningPersonalized Federated LearningFedFR: Joint Optimization Federated Framework for Generic and Personalized Face Recognition
Current state-of-the-art deep learning based face recognition (FR) models require a large number of face identities for central training. However, due to the growing privacy awareness, it is prohibited to access the face…
Face RecognitionFederated LearningSpectral Co-Distillation for Personalized Federated Learning
Personalized federated learning (PFL) has been widely investigated to address the challenge of data heterogeneity, especially when a single generic model is inadequate in satisfying the diverse performance requirements o…
Federated LearningPersonalized Federated Learning