Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Framework
We introduce FedGVI, a probabilistic Federated Learning (FL) framework that is robust to both prior and likelihood misspecification. FedGVI addresses limitations in both frequentist and Bayesian FL by providing unbiased predictions under model misspecification, with calibrated uncertainty quantification. Our approach generalises previous FL approaches, specifically Partitioned Variational Inference (Ashman et al., 2022), by allowing robust and conjugate updates, decreasing computational complexity at the clients. We offer theoretical analysis in terms of fixed-point convergence, optimality of the cavity distribution, and provable robustness to likelihood misspecification. Further, we empirically demonstrate the effectiveness of FedGVI in terms of improved robustness and predictive performance on multiple synthetic and real world classification data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningUncertainty QuantificationVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach
The canonical formulation of federated learning treats it as a distributed optimization problem where the model parameters are optimized against a global loss function that decomposes across client loss functions. A rece…
Distributed OptimizationFederated LearningVariational InferencePartitioned Variational Inference: A Framework for Probabilistic Federated Learning
The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often r…
Federated LearningVariational InferenceRates of Convergence of Generalised Variational Inference Posteriors under Prior Misspecification
We prove rates of convergence and robustness to prior misspecification within a Generalised Variational Inference (GVI) framework with bounded divergences. This addresses a significant open challenge for GVI and Federate…
Federated Variational Inference Methods for Structured Latent Variable Models
Federated learning methods enable model training across distributed data sources without data leaving their original locations and have gained increasing interest in various fields. However, existing approaches are limit…
Federated LearningTopic ModelsVariational InferenceFederated Learning with Decoupled Probabilistic-Weighted Gradient Aggregation
In the federated learning paradigm, multiple mobile clients train local models independently based on datasets generated by edge devices, and the server aggregates parameters/gradients from local models to form a global…
Federated LearningVariational Inference