Federated Learning of Dynamic Bayesian Network via Continuous Optimization from Time Series Data
Traditionally, learning the structure of a Dynamic Bayesian Network has been centralized, requiring all data to be pooled in one location. However, in real-world scenarios, data are often distributed across multiple entities (e.g., companies, devices) that seek to collaboratively learn a Dynamic Bayesian Network while preserving data privacy and security. More importantly, due to the presence of diverse clients, the data may follow different distributions, resulting in data heterogeneity. This heterogeneity poses additional challenges for centralized approaches. In this study, we first introduce a federated learning approach for estimating the structure of a Dynamic Bayesian Network from homogeneous time series data that are horizontally distributed across different parties. We then extend this approach to heterogeneous time series data by incorporating a proximal operator as a regularization term in a personalized federated learning framework. To this end, we propose \texttt{FDBNL} and \texttt{PFDBNL}, which leverage continuous optimization, ensuring that only model parameters are exchanged during the optimization process. Experimental results on synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art techniques, particularly in scenarios with many clients and limited individual sample sizes.
Code (1)
Tasks
Causal DiscoveryFederated LearningPersonalized Federated LearningTime SeriesSimilar Papers 제목 키워드 기반
Towards Federated Bayesian Network Structure Learning with Continuous Optimization
Traditionally, Bayesian network structure learning is often carried out at a central site, in which all data is gathered. However, in practice, data may be distributed across different parties (e.g., companies, devices) …
Federated LearningHybrid Parameter Search and Dynamic Model Selection for Mixed-Variable Bayesian Optimization
This paper presents a new type of hybrid model for Bayesian optimization (BO) adept at managing mixed variables, encompassing both quantitative (continuous and integer) and qualitative (categorical) types. Our proposed n…
Bayesian OptimizationGaussian ProcessesModel SelectionPositionHybrid Reinforcement Learning Framework for Mixed-Variable Problems
Optimization problems characterized by both discrete and continuous variables are common across various disciplines, presenting unique challenges due to their complex solution landscapes and the difficulty of navigating …
Bayesian Optimizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Federated PAC-Bayesian Learning on Non-IID data
Existing research has either adapted the Probably Approximately Correct (PAC) Bayesian framework for federated learning (FL) or used information-theoretic PAC-Bayesian bounds while introducing their theorems, but few con…
Federated LearningFedECADO: A Dynamical System Model of Federated Learning
Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inco…
Distributed OptimizationFederated LearningmodelSensitivity