Federated Semi-Supervised Domain Adaptation via Knowledge Transfer
Given the rapidly changing machine learning environments and expensive data labeling, semi-supervised domain adaptation (SSDA) is imperative when the labeled data from the source domain is statistically different from the partially labeled data from the target domain. Most prior SSDA research is centrally performed, requiring access to both source and target data. However, data in many fields nowadays is generated by distributed end devices. Due to privacy concerns, the data might be locally stored and cannot be shared, resulting in the ineffectiveness of existing SSDA research. This paper proposes an innovative approach to achieve SSDA over multiple distributed and confidential datasets, named by Federated Semi-Supervised Domain Adaptation (FSSDA). FSSDA integrates SSDA with federated learning based on strategically designed knowledge distillation techniques, whose efficiency is improved by performing source and target training in parallel. Moreover, FSSDA controls the amount of knowledge transferred across domains by properly selecting a key parameter, i.e., the imitation parameter. Further, the proposed FSSDA can be effectively generalized to multi-source domain adaptation scenarios. Extensive experiments are conducted to demonstrate the effectiveness and efficiency of FSSDA design.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationFederated LearningKnowledge DistillationSemi-supervised Domain AdaptationTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Closer to Reality: Practical Semi-Supervised Federated Learning for Foundation Model Adaptation
Foundation models (FMs) exhibit remarkable generalization but require adaptation to downstream tasks, particularly in privacy-sensitive applications. Due to data privacy regulations, cloud-based FMs cannot directly acces…
Federated LearningAutonomous DrivingObject DetectionFedSemiDG: Domain Generalized Federated Semi-supervised Medical Image Segmentation
Medical image segmentation is challenging due to the diversity of medical images and the lack of labeled data, which motivates recent developments in federated semi-supervised learning (FSSL) to leverage a large amount o…
Domain GeneralizationImage SegmentationMedical Image SegmentationPseudo Label+2Federated Adversarial Domain Adaptation
Federated learning improves data privacy and efficiency in machine learning performed over networks of distributed devices, such as mobile phones, IoT and wearable devices, etc. Yet models trained with federated learning…
DisentanglementDomain AdaptationFederated Learningtext-classification+2Knowledge distillation for semi-supervised domain adaptation
In the absence of sufficient data variation (e.g., scanner and protocol variability) in annotated data, deep neural networks (DNNs) tend to overfit during training. As a result, their performance is significantly lower o…
Domain AdaptationKnowledge DistillationSemi-supervised Domain AdaptationWhen does the student surpass the teacher? Federated Semi-supervised Learning with Teacher-Student EMA
Semi-Supervised Learning (SSL) has received extensive attention in the domain of computer vision, leading to development of promising approaches such as FixMatch. In scenarios where training data is decentralized and res…
Federated Learningimage-classificationImage ClassificationPseudo Label