paper-with-me

Papers

Predictive Learning on Hidden Tree-Structured Ising Models

2018-12-11 · Konstantinos E. Nikolakakis, Dionysios S. Kalogerias, Anand D. Sarwate

We provide high-probability sample complexity guarantees for exact structure recovery and accurate predictive learning using noise-corrupted samples from an acyclic (tree-shaped) graphical model. The hidden variables follow a tree-structured Ising model distribution, whereas the observable variables are generated by a binary symmetric channel taking the hidden variables as its input (flipping each bit independently with some constant probability $q\in [0,1/2)$). In the absence of noise, predictive learning on Ising models was recently studied by Bresler and Karzand (2020); this paper quantifies how noise in the hidden model impacts the tasks of structure recovery and marginal distribution estimation by proving upper and lower bounds on the sample complexity. Our results generalize state-of-the-art bounds reported in prior work, and they exactly recover the noiseless case ($q=0$). In fact, for any tree with $p$ vertices and probability of incorrect recovery $\delta>0$, the sufficient number of samples remains logarithmic as in the noiseless case, i.e., $\mathcal{O}(\log(p/\delta))$, while the dependence on $q$ is $\mathcal{O}\big( 1/(1-2q)^{4} \big)$, for both aforementioned tasks. We also present a new equivalent of Isserlis' Theorem for sign-valued tree-structured distributions, yielding a new low-complexity algorithm for higher-order moment estimation.

📄 PDF Abstract BibTeX arXiv:1812.04700

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Ising Models with Hidden Markov Structure: Applications to Probabilistic Inference in Machine Learning

2025-04-14 · F. Herrera, U. A. Rozikov, M. V. Velasco

In this paper, we investigate tree-indexed Markov chains (Gibbs measures) defined by a Hamiltonian that couples two Ising layers: hidden spins \(s(x) \in \{\pm 1\}\) and observed spins \(\sigma(x) \in \{\pm 1\}\) on a Ca…

Anomaly DetectionDenoisingWeakly-supervised Learning

Learning Tree Distributions by Hidden Markov Models

2018-05-31 · Davide Bacciu, Daniele Castellana

Hidden tree Markov models allow learning distributions for tree structured data while being interpretable as nondeterministic automata. We provide a concise summary of the main approaches in literature, focusing in parti…

Leveraging Predictive Equivalence in Decision Trees

2025-06-17 · Hayden McTavish, Zachery Boner, Jon Donnelly, Margo Seltzer 외

Decision trees are widely used for interpretable machine learning due to their clearly structured reasoning process. However, this structure belies a challenge we refer to as predictive equivalence: a given tree's decisi…

Interpretable Machine LearningMissing ValuesModel Selection

Bayesian Tensor Factorisation for Bottom-up Hidden Tree Markov Models

2019-05-31 · Daniele Castellana, Davide Bacciu

Bottom-Up Hidden Tree Markov Model is a highly expressive model for tree-structured data. Unfortunately, it cannot be used in practice due to the intractable size of its state-transition matrix. We propose a new approxim…

Toward Transparent Sequence Models with Model-Based Tree Markov Model

2023-07-28 · Chan Hsu, Wei-Chun Huang, Jun-Ting Wu, Chih-Yuan Li 외

In this study, we address the interpretability issue in complex, black-box Machine Learning models applied to sequence data. We introduce the Model-Based tree Hidden Semi-Markov Model (MOB-HSMM), an inherently interpreta…

model