홈 › Papers

Leveraging Foundation Models for Efficient Federated Learning in Resource-restricted Edge Networks

2024-09-14 · Submitted to ICASSP2025 2024 9 · S. Kawa Atapour, S. Jamal Seyedmohammadi, S. Mohammad Sheikholeslami, Jamshid Abouei, Konstantinos N. Plataniotis, Arash Mohammadi

Recently pre-trained Foundation Models (FMs) have been combined with Federated Learning (FL) to improve training of downstream tasks while preserving privacy. However, deploying FMs over edge networks with resource-constrained Internet of Things (IoT) devices is under-explored. This paper proposes a novel framework, namely, Federated Distilling knowledge to Prompt (FedD2P), for leveraging the robust representation abilities of a vision-language FM without deploying it locally on edge devices. This framework distills the aggregated knowledge of IoT devices to a prompt generator to efficiently adapt the frozen FM for downstream tasks. To eliminate the dependency on a public dataset, our framework leverages perclass local knowledge from IoT devices and linguistic descriptions of classes to train the prompt generator. Our experiments on diverse image classification datasets CIFAR, OxfordPets, SVHN, EuroSAT, and DTD show that FedD2P outperforms the baselines in terms of model performance.

📄 PDF Abstract BibTeX arXiv:2409.09273

Code (0)

등록된 구현이 없습니다.

Tasks

Data-free Knowledge Distillation Federated Learning image-classification Image Classification Prompt Engineering

Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approach

2026-01-29 · Yinlin Zhu, Di Wu, Xianzhi Zhang, Yuming Ai 외 arxiv

Recent studies of federated graph foundational models (FedGFMs) break the idealized and untenable assumption of having centralized data storage to train graph foundation models, and accommodate the reality of distributed…

Contrastive Learning General Knowledge

Bridging the Gap Between Foundation Models and Heterogeneous Federated Learning

2023-09-30 · Sixing Yu, J. Pablo Muñoz, Ali Jannesari

Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artifi…

Federated Learning Model Compression Privacy Preserving

Federated Low-Rank Adaptation for Foundation Models: A Survey

2025-05-16 · Yiyuan Yang, Guodong Long, Qinghua Lu, Liming Zhu 외

Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework that enables multiple users to fine-tune …

Federated Learning Survey

Ten Challenging Problems in Federated Foundation Models

2025-02-14 · Tao Fan, Hanlin Gu, Xuemei Cao, Chee Seng Chan 외

Federated Foundation Models (FedFMs) represent a distributed learning paradigm that fuses general competences of foundation models as well as privacy-preserving capabilities of federated learning. This combination allows…

Continual Learning Federated Learning Privacy Preserving Transfer Learning

DSFedMed: Dual-Scale Federated Medical Image Segmentation via Mutual Distillation Between Foundation and Lightweight Models

2026-01-22 · Hanwen Zhang, Qiaojin Shen, Yuxi Liu, Yuesheng Zhu 외 arxiv

Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, …

Medical Image Segmentation Knowledge Distillation General Knowledge