paper-with-me

Papers

Personalized Federated Learning via Amortized Bayesian Meta-Learning

2023-07-05 · Shiyu Liu, Shaogao Lv, Dun Zeng, Zenglin Xu, Hui Wang, Yue Yu

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical heterogeneity among clients poses a challenge, as the global model may struggle to perform well on each client's specific task. To address this issue, we introduce a new perspective on personalized federated learning through Amortized Bayesian Meta-Learning. Specifically, we propose a novel algorithm called \emph{FedABML}, which employs hierarchical variational inference across clients. The global prior aims to capture representations of common intrinsic structures from heterogeneous clients, which can then be transferred to their respective tasks and aid in the generation of accurate client-specific approximate posteriors through a few local updates. Our theoretical analysis provides an upper bound on the average generalization error and guarantees the generalization performance on unseen data. Finally, several empirical results are implemented to demonstrate that \emph{FedABML} outperforms several competitive baselines.

📄 PDF Abstract BibTeX arXiv:2307.02222

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningMeta-LearningPersonalized Federated LearningPrivacy PreservingVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Few-shot Generation of Personalized Neural Surrogates for Cardiac Simulation via Bayesian Meta-Learning

2022-10-06 · Xiajun Jiang, Zhiyuan Li, Ryan Missel, Md Shakil Zaman 외

Clinical adoption of personalized virtual heart simulations faces challenges in model personalization and expensive computation. While an ideal solution is an efficient neural surrogate that at the same time is personali…

Meta-LearningVariational Inference

Probabilistic Federated Learning on Uncertain and Heterogeneous Data with Model Personalization

2026-03-18 · Ratun Rahman, Dinh C. Nguyen arxiv

Conventional federated learning (FL) frameworks often suffer from training degradation due to data uncertainty and heterogeneity across local clients. Probabilistic approaches such as Bayesian neural networks (BNNs) can …

Federated Learning

Meta-Learning at Scale for Large Language Models via Low-Rank Amortized Bayesian Meta-Learning

2025-08-19 · Liyi Zhang, Jake Snell, Thomas L. Griffiths arxiv

Fine-tuning large language models (LLMs) with low-rank adaptation (LoRA) is a cost-effective way to incorporate information from a specific dataset. However, when a problem requires incorporating information from multipl…

Scalable Vertical Federated Learning via Data Augmentation and Amortized Inference

2024-05-07 · Conor Hassan, Matthew Sutton, Antonietta Mira, Kerrie Mengersen

Vertical federated learning (VFL) has emerged as a paradigm for collaborative model estimation across multiple clients, each holding a distinct set of covariates. This paper introduces the first comprehensive framework f…

Bayesian InferenceData AugmentationFederated LearningPrivacy Preserving+2

CoMetaPNS: Continually Meta-learning Personalized Neural Surrogates for Cardiac Electrophysiology Simulations

2026-06-05 · Ryan Missel, Xiajun Jiang, Linwei Wang arxiv

Personalized virtual heart simulations face challenges in model personalization and computational cost. While neural surrogates offer state-of-the-art solutions, they typically address either efficient personalization or…