Federated Contrastive Learning for Decentralized Unlabeled Medical Images
A label-efficient paradigm in computer vision is based on self-supervised contrastive pre-training on unlabeled data followed by fine-tuning with a small number of labels. Making practical use of a federated computing environment in the clinical domain and learning on medical images poses specific challenges. In this work, we propose FedMoCo, a robust federated contrastive learning (FCL) framework, which makes efficient use of decentralized unlabeled medical data. FedMoCo has two novel modules: metadata transfer, an inter-node statistical data augmentation module, and self-adaptive aggregation, an aggregation module based on representational similarity analysis. To the best of our knowledge, this is the first FCL work on medical images. Our experiments show that FedMoCo can consistently outperform FedAvg, a seminal federated learning framework, in extracting meaningful representations for downstream tasks. We further show that FedMoCo can substantially reduce the amount of labeled data required in a downstream task, such as COVID-19 detection, to achieve a reasonable performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningData AugmentationFederated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Federated Self-Supervised Contrastive Learning and Masked Autoencoder for Dermatological Disease Diagnosis
In dermatological disease diagnosis, the private data collected by mobile dermatology assistants exist on distributed mobile devices of patients. Federated learning (FL) can use decentralized data to train models while k…
Contrastive LearningFederated LearningSelf-Supervised LearningSelfFed: Self-supervised Federated Learning for Data Heterogeneity and Label Scarcity in IoMT
Self-supervised learning in federated learning paradigm has been gaining a lot of interest both in industry and research due to the collaborative learning capability on unlabeled yet isolated data. However, self-supervis…
Federated LearningSelf-Supervised LearningDistributed Contrastive Learning for Medical Image Segmentation
Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffecti…
Contrastive LearningFederated LearningImage SegmentationMedical Image Segmentation+3Federated Unsupervised Visual Representation Learning via Exploiting General Content and Personal Style
Discriminative unsupervised learning methods such as contrastive learning have demonstrated the ability to learn generalized visual representations on centralized data. It is nonetheless challenging to adapt such methods…
Contrastive LearningFederated LearningRepresentation LearningScale Federated Learning for Label Set Mismatch in Medical Image Classification
Federated learning (FL) has been introduced to the healthcare domain as a decentralized learning paradigm that allows multiple parties to train a model collaboratively without privacy leakage. However, most previous stud…
Federated Learningimage-classificationImage ClassificationMedical Image Classification+1