paper-with-me

Papers

Normalized Maximum Likelihood Code-Length on Riemannian Data Spaces

2025-08-29 · Kota Fukuzawa, Atsushi Suzuki, Kenji Yamanishi arxiv

In recent years, with the large-scale expansion of graph data, there has been an increased focus on Riemannian manifold data spaces other than Euclidean space. In particular, the development of hyperbolic spaces has been remarkable, and they have high expressive power for graph data with hierarchical structures. Normalized Maximum Likelihood (NML) is employed in regret minimization and model selection. However, existing formulations of NML have been developed primarily in Euclidean spaces and are inherently dependent on the choice of coordinate systems, making it non-trivial to extend NML to Riemannian manifolds. In this study, we define a new NML that reflects the geometric structure of Riemannian manifolds, called the Riemannian manifold NML (Rm-NML). This Rm-NML is invariant under coordinate transformations and coincides with the conventional NML under the natural parameterization in Euclidean space. We extend existing computational techniques for NML to the setting of Riemannian manifolds. Furthermore, we derive a method to simplify the computation of Rm-NML on Riemannian symmetric spaces, which encompass data spaces of growing interest such as hyperbolic spaces. To illustrate the practical application of our proposed method, we explicitly computed the Rm-NML for normal distributions on hyperbolic spaces.

📄 PDF Abstract BibTeX arXiv:2508.21466

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Foundation of Calculating Normalized Maximum Likelihood for Continuous Probability Models

2024-09-12 · Atsushi Suzuki, Kota Fukuzawa, Kenji Yamanishi

The normalized maximum likelihood (NML) code length is widely used as a model selection criterion based on the minimum description length principle, where the model with the shortest NML code length is selected. A common…

Model Selection

Bayesian Properties of Normalized Maximum Likelihood and its Fast Computation

2014-01-28 · Andrew Barron, Teemu Roos, Kazuho Watanabe

The normalized maximized likelihood (NML) provides the minimax regret solution in universal data compression, gambling, and prediction, and it plays an essential role in the minimum description length (MDL) method of sta…

Data CompressionPrediction

Renormalized Normalized Maximum Likelihood and Three-Part Code Criteria For Learning Gaussian Networks

2018-10-20 · Borzou Alipourfard, Jean X. Gao

Score based learning (SBL) is a promising approach for learning Bayesian networks in the discrete domain. However, when employing SBL in the continuous domain, one is either forced to move the problem to the discrete dom…

Amortized Conditional Normalized Maximum Likelihood

2020-09-28 · Aurick Zhou, Sergey Levine

While deep neural networks provide good performance for a range of challenging tasks, calibration and uncertainty estimation remain major challenges. In this paper, we propose the amortized conditional normalized maximum…

Bayesian Inference

Amortized Conditional Normalized Maximum Likelihood: Reliable Out of Distribution Uncertainty Estimation

2020-11-05 · Aurick Zhou, Sergey Levine

While deep neural networks provide good performance for a range of challenging tasks, calibration and uncertainty estimation remain major challenges, especially under distribution shift. In this paper, we propose the amo…

Bayesian Inference