FACMIC: Federated Adaptative CLIP Model for Medical Image Classification

2024-10-08 · Yihang Wu, Christian Desrosiers, Ahmad Chaddad

Federated learning (FL) has emerged as a promising approach to medical image analysis that allows deep model training using decentralized data while ensuring data privacy. However, in the field of FL, communication cost plays a critical role in evaluating the performance of the model. Thus, transferring vision foundation models can be particularly challenging due to the significant resource costs involved. In this paper, we introduce a federated adaptive Contrastive Language Image Pretraining CLIP model designed for classification tasks. We employ a light-weight and efficient feature attention module for CLIP that selects suitable features for each client's data. Additionally, we propose a domain adaptation technique to reduce differences in data distribution between clients. Experimental results on four publicly available datasets demonstrate the superior performance of FACMIC in dealing with real-world and multisource medical imaging data. Our codes are available at https://github.com/AIPMLab/FACMIC.

📄 PDF Abstract BibTeX arXiv:2410.14707

Code (1)

aipmlab/facmic 공식 구현 pytorch

Tasks

Domain Adaptation Federated Learning image-classification Image ClassificationMedical Image AnalysisMedical Image Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

FAA-CLIP: Federated Adversarial Adaptation of CLIP

2025-02-26 · Yihang Wu, Ahmad Chaddad, Christian Desrosiers, Tareef Daqqaq 외

Despite the remarkable performance of vision language models (VLMs) such as Contrastive Language Image Pre-training (CLIP), the large size of these models is a considerable obstacle to their use in federated learning (FL…

Domain Adaptation Federated Learning

Federated CLIP for Resource-Efficient Heterogeneous Medical Image Classification

2025-11-11 · Yihang Wu, Ahmad Chaddad arxiv

Despite the remarkable performance of deep models in medical imaging, they still require source data for training, which limits their potential in light of privacy concerns. Federated learning (FL), as a decentralized le…

Medical Image Classification Federated Learning Model Compression

Deep Modeling and Optimization of Medical Image Classification

2025-05-29 · Yihang Wu, Muhammad Owais, Reem Kateb, Ahmad Chaddad

Deep models, such as convolutional neural networks (CNNs) and vision transformer (ViT), demonstrate remarkable performance in image classification. However, those deep models require large data to fine-tune, which is imp…

Avg Classification Federated Learning image-classification+3

Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

2024-05-10 · Xingyu Li, Lu Peng, Yuping Wang, Weihua Zhang

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such a…

Diagnostic Federated Learning Self-Supervised Learning Survey

PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance

2023-12-06 · Haichao Sha, Ruixuan Liu, Yixuan Liu, Hong Chen

The paradigm of Differentially Private SGD~(DP-SGD) can provide a theoretical guarantee for training data in both centralized and federated settings. However, the utility degradation caused by DP-SGD limits its wide appl…

Federated Learning