홈 › Papers

Partitioned Variational Inference: A Framework for Probabilistic Federated Learning

2022-02-24 · Matthew Ashman, Thang D. Bui, Cuong V. Nguyen, Stratis Markou, Adrian Weller, Siddharth Swaroop, Richard E. Turner

The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be stored on a single machine with compute performed by a single node, making them unsuitable for decentralised training on multiple devices. This deficiency has motivated the development of federated learning algorithms, which allow multiple data owners to train collaboratively and use a shared model whilst keeping local data private. However, many of these algorithms focus on obtaining point estimates of model parameters, rather than probabilistic estimates capable of capturing model uncertainty, which is essential in many applications. Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. In this paper we introduce partitioned variational inference (PVI), a general framework for performing VI in the federated setting. We develop new supporting theory for PVI, demonstrating a number of properties that make it an attractive choice for practitioners; use PVI to unify a wealth of fragmented, yet related literature; and provide empirical results that showcase the effectiveness of PVI in a variety of federated settings.

📄 PDF Abstract BibTeX arXiv:2202.12275

Code (1)

DPBayes/DPPVI pytorch

Tasks

Federated LearningVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Framework

2025-02-02 · Terje Mildner, Oliver Hamelijnck, Paris Giampouras, Theodoros Damoulas

We introduce FedGVI, a probabilistic Federated Learning (FL) framework that is robust to both prior and likelihood misspecification. FedGVI addresses limitations in both frequentist and Bayesian FL by providing unbiased …

Federated Learning Uncertainty Quantification Variational Inference

Partitioned Variational Inference: A unified framework encompassing federated and continual learning

2018-11-27 · Thang D. Bui, Cuong V. Nguyen, Siddharth Swaroop, Richard E. Turner

Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic option…

Continual Learning Distributed Computing Federated Learning Variational Inference

Differentially private partitioned variational inference

2022-09-23 · Mikko A. Heikkilä, Matthew Ashman, Siddharth Swaroop, Richard E. Turner 외

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim …

Federated Learning Privacy Preserving Variational Inference

Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach

2023-02-08 · Han Guo, Philip Greengard, Hongyi Wang, Andrew Gelman 외

The canonical formulation of federated learning treats it as a distributed optimization problem where the model parameters are optimized against a global loss function that decomposes across client loss functions. A rece…

Distributed Optimization Federated Learning Variational Inference

Differentially Private Federated Variational Inference

2019-11-24 · Mrinank Sharma, Michael Hutchinson, Siddharth Swaroop, Antti Honkela 외

In many real-world applications of machine learning, data are distributed across many clients and cannot leave the devices they are stored on. Furthermore, each client's data, computational resources and communication co…

Bayesian Inference Federated Learning Variational Inference