Recent Advances in Federated Learning Driven Large Language Models: A Survey on Architecture, Performance, and Security
Federated Learning (FL) offers a promising paradigm for training Large Language Models (LLMs) in a decentralized manner while preserving data privacy and minimizing communication overhead. This survey examines recent advancements in FL-driven LLMs, with a particular emphasis on architectural designs, performance optimization, and security concerns, including the emerging area of machine unlearning. In this context, machine unlearning refers to the systematic removal of specific data contributions from trained models to comply with privacy regulations such as the Right to be Forgotten. We review a range of strategies enabling unlearning in federated LLMs, including perturbation-based methods, model decomposition, and incremental retraining, while evaluating their trade-offs in terms of efficiency, privacy guarantees, and model utility. Through selected case studies and empirical evaluations, we analyze how these methods perform in practical FL scenarios. This survey identifies critical research directions toward developing secure, adaptable, and high-performing federated LLM systems for real-world deployment.
Code (0)
등록된 구현이 없습니다.
Tasks
EthicsFederated LearningIncremental LearningMachine UnlearningSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Federated Large Language Models: Current Progress and Future Directions
Large language models are rapidly gaining popularity and have been widely adopted in real-world applications. While the quality of training data is essential, privacy concerns arise during data collection. Federated lear…
Federated LearningPrompt LearningAnalogFed: Privacy-Preserving Discovery of Analog Circuits at Scale with Federated Generative AI
Recent advances in generative AI (GenAI) have shown transformative potential for modern hardware design. However, existing GenAI-driven approaches fall short of enabling large-scale electronic design automation (EDA) due…
Federated LearningModel-Driven Quantum Federated Learning (QFL)
Recently, several studies have proposed frameworks for Quantum Federated Learning (QFL). For instance, the Google TensorFlow Quantum (TFQ) and TensorFlow Federated (TFF) libraries have been deployed for realizing QFL. Ho…
Federated LearningmodelPositionQuantum Machine LearningNavigating the Future of Federated Recommendation Systems with Foundation Models
Federated Recommendation Systems (FRSs) offer a privacy-preserving alternative to traditional centralized approaches by decentralizing data storage. However, they face persistent challenges such as data sparsity and hete…
Federated LearningMultimodal RecommendationPositionPrivacy Preserving+3Position: Federated Foundation Language Model Post-Training Should Focus on Open-Source Models
Post-training of foundation language models has emerged as a promising research domain in federated learning (FL) with the goal to enable privacy-preserving model improvements and adaptations to user's downstream tasks. …
Federated LearningLanguage ModelingLanguage ModellingPosition+1