Federated Prompt Learning: A Unified Framework, Empirical Analysis, and Future Directions

2026-08-14 · Qinglin Yang, Chen Qiu, Hongyuan Zhang, Pengdeng Li, Yuan Liu, Zhihong Tian arxiv

Large language models (LLMs) have become core components of cloud-based intelligent services in academia and industry, yet their training and deployment are hindered by high computational costs, data centralization, and privacy concerns. Federated learning (FL) offers a decentralized training paradigm that enables clients to collaboratively train a learning model without sharing raw data, making it a promising solution for privacy-preserving LLM training and reasoning. This paper presents a comprehensive survey of federated prompt learning (FPL) to review recent advances in integrating the federated learning paradigm and large language models, answering the following research questions: RQ1: The fundamental motivations, characteristics, and enabling technologies of FPL, and how it differs from conventional FL and full-model federated fine-tuning; RQ2: The trade-offs FPL approaches exhibit in performance, communication efficiency, computational overhead, scalability, personalization, and heterogeneity handling; RQ3: The remaining security, privacy, robustness, and system challenges, along with key future research directions. To this end, we systematically examine existing FPL methods across the full model lifecycle: pre-training, fine-tuning, and practical applications, while discussing security, privacy, and robustness issues and summarizing existing defense mechanisms. Finally, we highlight open challenges and future directions, aiming to help readers understand how the insights drive research in FPL.

📄 PDF Abstract BibTeX arXiv:2608.13844

Code (1)

arxivsub/arXivSub_daily_arxiv ★ 4

Tasks

Federated Learning

Federated Learning from Vision-Language Foundation Models: Theoretical Analysis and Method

2024-09-29 · Bikang Pan, Wei Huang, Ye Shi

Integrating pretrained vision-language foundation models like CLIP into federated learning has attracted significant attention for enhancing generalization across diverse tasks. Typically, federated learning of vision-la…

Federated Learning Learning Theory Memorization Portfolio Optimization+1

Text-driven Prompt Generation for Vision-Language Models in Federated Learning

2023-10-09 · Chen Qiu, Xingyu Li, Chaithanya Kumar Mummadi, Madan Ravi Ganesh 외

Prompt learning for vision-language models, e.g., CoOp, has shown great success in adapting CLIP to different downstream tasks, making it a promising solution for federated learning due to computational reasons. Existing…

Federated Learning image-classification Image Classification Prompt Learning

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

2024-11-04 · Yuchen He, Chuyun Shen, Xiangfeng Wang, Bo Jin

Federated continual learning (FCL) aims to learn from sequential data stream in the decentralized federated learning setting, while simultaneously mitigating the catastrophic forgetting issue in classical continual learn…

Continual Learning Contrastive Learning Federated Learning Prompt Learning

Prompt Estimation from Prototypes for Federated Prompt Tuning of Vision Transformers

2025-10-29 · M Yashwanth, Sharannya Ghosh, Aditay Tripathi, Anirban Chakraborty arxiv

Visual Prompt Tuning (VPT) of pre-trained Vision Transformers (ViTs) has proven highly effective as a parameter-efficient fine-tuning technique for adapting large models to downstream tasks with limited data. Its paramet…

parameter-efficient fine-tuning Visual Prompt Tuning Federated Learning

Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning

2026-01-10 · Quan Minh Nguyen, Min-Seon Kim, Hoang M. Ngo, Trong Nghia Hoang 외 arxiv

Membership inference attack (MIA) poses a significant privacy threat in federated learning (FL) as it allows adversaries to determine whether a client's private dataset contains a specific data sample. While defenses aga…