Federated Model Aggregation via Self-Supervised Priors for Highly Imbalanced Medical Image Classification
In the medical field, federated learning commonly deals with highly imbalanced datasets, including skin lesions and gastrointestinal images. Existing federated methods under highly imbalanced datasets primarily focus on optimizing a global model without incorporating the intra-class variations that can arise in medical imaging due to different populations, findings, and scanners. In this paper, we study the inter-client intra-class variations with publicly available self-supervised auxiliary networks. Specifically, we find that employing a shared auxiliary pre-trained model, like MoCo-V2, locally on every client yields consistent divergence measurements. Based on these findings, we derive a dynamic balanced model aggregation via self-supervised priors (MAS) to guide the global model optimization. Fed-MAS can be utilized with different local learning methods for effective model aggregation toward a highly robust and unbiased global model. Our code is available at \url{https://github.com/xmed-lab/Fed-MAS}.
Code (1)
Tasks
Federated Learningimage-classificationImage ClassificationMedical Image ClassificationModel OptimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Feature Correlation-guided Knowledge Transfer for Federated Self-supervised Learning
To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches o…
Feature CorrelationFederated LearningKnowledge DistillationPrivacy Preserving+2L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning
The ubiquity of camera-enabled devices has led to large amounts of unlabeled image data being produced at the edge. The integration of self-supervised learning (SSL) and federated learning (FL) into one coherent system c…
Federated LearningRepresentation LearningSelf-Supervised LearningFederated Contrastive Learning for Decentralized Unlabeled Medical Images
A label-efficient paradigm in computer vision is based on self-supervised contrastive pre-training on unlabeled data followed by fine-tuning with a small number of labels. Making practical use of a federated computing en…
Contrastive LearningData AugmentationFederated LearningMobility-Aware Federated Self-supervised Learning in Vehicular Network
Federated Learning (FL) is an advanced distributed machine learning approach, that protects the privacy of each vehicle by allowing the model to be trained on multiple devices simultaneously without the need to upload al…
Federated LearningSelf-Supervised LearningDRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV
In the Internet of Vehicles (IoV), Federated Learning (FL) provides a privacy-preserving solution by aggregating local models without sharing data. Traditional supervised learning requires image data with labels, but dat…
CPUDeep Reinforcement LearningFederated LearningPrivacy Preserving+1