paper-with-me

Papers

Federated Bayesian Network Ensembles

2024-02-19 · Florian van Daalen, Lianne Ippel, Andre Dekker, Inigo Bermejo

Federated learning allows us to run machine learning algorithms on decentralized data when data sharing is not permitted due to privacy concerns. Ensemble-based learning works by training multiple (weak) classifiers whose output is aggregated. Federated ensembles are ensembles applied to a federated setting, where each classifier in the ensemble is trained on one data location. In this article, we explore the use of federated ensembles of Bayesian networks (FBNE) in a range of experiments and compare their performance with locally trained models and models trained with VertiBayes, a federated learning algorithm to train Bayesian networks from decentralized data. Our results show that FBNE outperforms local models and provides a significant increase in training speed compared with VertiBayes while maintaining a similar performance in most settings, among other advantages. We show that FBNE is a potentially useful tool within the federated learning toolbox, especially when local populations are heavily biased, or there is a strong imbalance in population size across parties. We discuss the advantages and disadvantages of this approach in terms of time complexity, model accuracy, privacy protection, and model interpretability.

📄 PDF Abstract BibTeX arXiv:2402.12142

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Bayesian posterior approximation with stochastic ensembles

2022-12-15 · CVPR 2023 1 · Oleksandr Balabanov, Bernhard Mehlig, Hampus Linander

We introduce ensembles of stochastic neural networks to approximate the Bayesian posterior, combining stochastic methods such as dropout with deep ensembles. The stochastic ensembles are formulated as families of distrib…

Bayesian Inferenceimage-classificationImage ClassificationVariational Inference

Deep Ensembles Secretly Perform Empirical Bayes

2025-01-29 · Gabriel Loaiza-Ganem, Valentin Villecroze, Yixin Wang

Quantifying uncertainty in neural networks is a highly relevant problem which is essential to many applications. The two predominant paradigms to tackle this task are Bayesian neural networks (BNNs) and deep ensembles. D…

Deep Ensembles from a Bayesian Perspective

2021-05-27 · Lara Hoffmann, Clemens Elster

Deep ensembles can be considered as the current state-of-the-art for uncertainty quantification in deep learning. While the approach was originally proposed as a non-Bayesian technique, arguments supporting its Bayesian …

Uncertainty Quantification

SAE: Sequential Anchored Ensembles

2021-12-30 · Arnaud Delaunoy, Gilles Louppe

Computing the Bayesian posterior of a neural network is a challenging task due to the high-dimensionality of the parameter space. Anchored ensembles approximate the posterior by training an ensemble of neural networks on…

On Uniform, Bayesian, and PAC-Bayesian Deep Ensembles

2024-06-08 · Nick Hauptvogel, Christian Igel

It is common practice to combine deep neural networks into ensembles. These deep ensembles can benefit from the cancellation of errors effect: Errors by ensemble members may average out, leading to better generalization …