paper-with-me

Papers

Renormalized Normalized Maximum Likelihood and Three-Part Code Criteria For Learning Gaussian Networks

2018-10-20 · Borzou Alipourfard, Jean X. Gao

Score based learning (SBL) is a promising approach for learning Bayesian networks in the discrete domain. However, when employing SBL in the continuous domain, one is either forced to move the problem to the discrete domain or use metrics such as BIC/AIC, and these approaches are often lacking. Discretization can have an undesired impact on the accuracy of the results, and BIC/AIC can fall short of achieving the desired accuracy. In this paper, we introduce two new scoring metrics for scoring Bayesian networks in the continuous domain: the three-part minimum description length and the renormalized normalized maximum likelihood metric. We rely on the minimum description length principle in formulating these metrics. The metrics proposed are free of hyperparameters, decomposable, and are asymptotically consistent. We evaluate our solution by studying the convergence rate of the learned graph to the generating network and, also, the structural hamming distance of the learned graph to the generating network. Our evaluations show that the proposed metrics outperform their competitors, the BIC/AIC metrics. Furthermore, using the proposed RNML metric, SBL will have the fastest rate of convergence with the smallest structural hamming distance to the generating network.

📄 PDF Abstract BibTeX arXiv:1810.08749

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Does Learning Renormalize? Sufficient Conditions for Power Law Spectral Dynamics

2025-12-20 · Yizhou Zhang arxiv

Empirical power--law scaling has been widely observed across modern deep learning systems, yet its theoretical origins and scope of validity remain incompletely understood. The Generalized Resolution--Shell Dynamics (GRS…

Renormalized Mutual Information for Artificial Scientific Discovery

2020-05-04 · Leopoldo Sarra, Andrea Aiello, Florian Marquardt

We derive a well-defined renormalized version of mutual information that allows to estimate the dependence between continuous random variables in the important case when one is deterministically dependent on the other. T…

Dimensionality Reductionscientific discovery

Bayesian Properties of Normalized Maximum Likelihood and its Fast Computation

2014-01-28 · Andrew Barron, Teemu Roos, Kazuho Watanabe

The normalized maximized likelihood (NML) provides the minimax regret solution in universal data compression, gambling, and prediction, and it plays an essential role in the minimum description length (MDL) method of sta…

Data CompressionPrediction

Signal inference with unknown response: Calibration-uncertainty renormalized estimator

2014-10-23 · Sebastian Dorn, Torsten A. Enßlin, Maksim Greiner, Marco Selig 외

The calibration of a measurement device is crucial for every scientific experiment, where a signal has to be inferred from data. We present CURE, the calibration uncertainty renormalized estimator, to reconstruct a signa…

Quotient Normalized Maximum Likelihood Criterion for Learning Bayesian Network Structures

2024-08-27 · Tomi Silander, Janne Leppä-aho, Elias Jääsaari, Teemu Roos

We introduce an information theoretic criterion for Bayesian network structure learning which we call quotient normalized maximum likelihood (qNML). In contrast to the closely related factorized normalized maximum likeli…