Learning Dynamic Bayesian Networks from Data: Foundations, First Principles and Numerical Comparisons

2024-06-25 · Vyacheslav Kungurtsev, Fadwa Idlahcen, Petr Rysavy, Pavel Rytir, Ales Wodecki

In this paper, we present a guide to the foundations of learning Dynamic Bayesian Networks (DBNs) from data in the form of multiple samples of trajectories for some length of time. We present the formalism for a generic as well as a set of common types of DBNs for particular variable distributions. We present the analytical form of the models, with a comprehensive discussion on the interdependence between structure and weights in a DBN model and their implications for learning. Next, we give a broad overview of learning methods and describe and categorize them based on the most important statistical features, and how they treat the interplay between learning structure and weights. We give the analytical form of the likelihood and Bayesian score functions, emphasizing the distinction from the static case. We discuss functions used in optimization to enforce structural requirements. We briefly discuss more complex extensions and representations. Finally we present a set of comparisons in different settings for various distinct but representative algorithms across the variants.

📄 PDF Abstract BibTeX arXiv:2406.17585

Code (0)

등록된 구현이 없습니다.

Tasks

Form

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Formalising the Foundations of Discrete Reinforcement Learning in Isabelle/HOL

2021-12-11 · Mark Chevallier, Jacques Fleuriot

We present a formalisation of finite Markov decision processes with rewards in the Isabelle theorem prover. We focus on the foundations required for dynamic programming and the use of reinforcement learning agents over s…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Extending Multi-Source Bayesian Optimization With Causality Principles

2026-02-16 · Luuk Jacobs, Mohammad Ali Javidian arxiv

Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple infor…

Dimensionality Reduction

Redeeming Data Science by Decision Modelling

2023-06-30 · John Mark Agosta, Robert Horton

With the explosion of applications of Data Science, the field is has come loose from its foundations. This article argues for a new program of applied research in areas familiar to researchers in Bayesian methods in AI t…

Statistical Machine Learning for Astronomy -- A Textbook

2025-06-13 · Yuan-Sen Ting

This textbook provides a systematic treatment of statistical machine learning for astronomical research through the lens of Bayesian inference, developing a unified framework that reveals connections between modern data …

Astronomy Bayesian Inference Gaussian Processes Uncertainty Quantification

Foundations of Schrödinger Bridges for Generative Modeling

2026-03-19 · Sophia Tang arxiv

At the core of modern generative modeling frameworks, including diffusion models, score-based models, and flow matching, is the task of transforming a simple prior distribution into a complex target distribution through …