Channel-driven Decentralized Bayesian Federated Learning for Trustworthy Decision Making in D2D Networks
Bayesian Federated Learning (FL) offers a principled framework to account for the uncertainty caused by limitations in the data available at the nodes implementing collaborative training. In Bayesian FL, nodes exchange information about local posterior distributions over the model parameters space. This paper focuses on Bayesian FL implemented in a device-to-device (D2D) network via Decentralized Stochastic Gradient Langevin Dynamics (DSGLD), a recently introduced gradient-based Markov Chain Monte Carlo (MCMC) method. Based on the observation that DSGLD applies random Gaussian perturbations of model parameters, we propose to leverage channel noise on the D2D links as a mechanism for MCMC sampling. The proposed approach is compared against a conventional implementation of frequentist FL based on compression and digital transmission, highlighting advantages and limitations.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingFederated LearningSimilar Papers 제목 키워드 기반
Bayesian Variational Federated Learning and Unlearning in Decentralized Networks
Federated Bayesian learning offers a principled framework for the definition of collaborative training algorithms that are able to quantify epistemic uncertainty and to produce trustworthy decisions. Upon the completion …
Federated LearningVariational InferenceDecentralized Quantum Federated Learning for Metaverse: Analysis, Design and Implementation
With the emerging developments of the Metaverse, a virtual world where people can interact, socialize, play, and conduct their business, it has become critical to ensure that the underlying systems are transparent, secur…
Federated LearningBayesian Over-the-Air FedAvg via Channel Driven Stochastic Gradient Langevin Dynamics
The recent development of scalable Bayesian inference methods has renewed interest in the adoption of Bayesian learning as an alternative to conventional frequentist learning that offers improved model calibration via un…
Bayesian InferenceUncertainty QuantificationOn the Convergence of Decentralized Federated Learning Under Imperfect Information Sharing
Decentralized learning and optimization is a central problem in control that encompasses several existing and emerging applications, such as federated learning. While there exists a vast literature on this topic and most…
Distributed OptimizationFederated LearningIncentives for Federated Learning: a Hypothesis Elicitation Approach
Federated learning provides a promising paradigm for collecting machine learning models from distributed data sources without compromising users' data privacy. The success of a credible federated learning system builds o…
BIG-bench Machine LearningFederated Learningscoring rule