Knowledge-Injected Federated Learning
Federated learning is an emerging technique for training models from decentralized data sets. In many applications, data owners participating in the federated learning system hold not only the data but also a set of domain knowledge. Such knowledge includes human know-how and craftsmanship that can be extremely helpful to the federated learning task. In this work, we propose a federated learning framework that allows the injection of participants' domain knowledge, where the key idea is to refine the global model with knowledge locally. The scenario we consider is motivated by a real industry-level application, and we demonstrate the effectiveness of our approach to this application.
Code (1)
Tasks
Federated LearningSimilar Papers 제목 키워드 기반
Technical Report: Assisting Backdoor Federated Learning with Whole Population Knowledge Alignment
Due to the distributed nature of Federated Learning (FL), researchers have uncovered that FL is vulnerable to backdoor attacks, which aim at injecting a sub-task into the FL without corrupting the performance of the main…
Backdoor AttackFederated LearningInference AttackMH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis
Federated learning is widely used in medical applications for training global models without needing local data access. However, varying computational capabilities and network architectures (system heterogeneity), across…
Federated LearningKnowledge DistillationPersonalized Federated LearningOn Convergence of Federated Averaging Langevin Dynamics
We propose a federated averaging Langevin algorithm (FA-LD) for uncertainty quantification and mean predictions with distributed clients. In particular, we generalize beyond normal posterior distributions and consider a …
Uncertainty QuantificationPIP: Prototypes-Injected Prompt for Federated Class Incremental Learning
Federated Class Incremental Learning (FCIL) is a new direction in continual learning (CL) for addressing catastrophic forgetting and non-IID data distribution simultaneously. Existing FCIL methods call for high communica…
class-incremental learningClass Incremental LearningContinual LearningIncremental Learning+1Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge
Pre-trained language models (LMs) are used for knowledge intensive tasks like question answering, but their knowledge gets continuously outdated as the world changes. Prior work has studied targeted updates to LMs, injec…
Question Answering