paper-with-me

홈 › Papers

Spectral Learning of Large Structured HMMs for Comparative Epigenomics

2015-06-04 · NeurIPS 2015 12 · Chicheng Zhang, Jimin Song, Kevin C Chen, Kamalika Chaudhuri

We develop a latent variable model and an efficient spectral algorithm motivated by the recent emergence of very large data sets of chromatin marks from multiple human cell types. A natural model for chromatin data in one cell type is a Hidden Markov Model (HMM); we model the relationship between multiple cell types by connecting their hidden states by a fixed tree of known structure. The main challenge with learning parameters of such models is that iterative methods such as EM are very slow, while naive spectral methods result in time and space complexity exponential in the number of cell types. We exploit properties of the tree structure of the hidden states to provide spectral algorithms that are more computationally efficient for current biological datasets. We provide sample complexity bounds for our algorithm and evaluate it experimentally on biological data from nine human cell types. Finally, we show that beyond our specific model, some of our algorithmic ideas can be applied to other graphical models.

📄 PDF Abstract BibTeX arXiv:1506.01744

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Spectral Learning of Binomial HMMs for DNA Methylation Data

2018-02-07 · Chicheng Zhang, Eran A. Mukamel, Kamalika Chaudhuri

We consider learning parameters of Binomial Hidden Markov Models, which may be used to model DNA methylation data. The standard algorithm for the problem is EM, which is computationally expensive for sequences of the sca…

Computational EfficiencyTensor Decomposition

Implementing spectral methods for hidden Markov models with real-valued emissions

2014-04-29 · Carl Mattfeld

Hidden Markov models (HMMs) are widely used statistical models for modeling sequential data. The parameter estimation for HMMs from time series data is an important learning problem. The predominant methods for parameter…

parameter estimationTime SeriesTime Series Analysis

Spectral Learning of Refinement HMMs

2013-08-01 · WS 2013 8 · Karl Stratos, Alex Rush, er, Shay B. Cohen 외

A Spectral Algorithm for Learning Hidden Markov Models

2008-11-26 · Daniel Hsu, Sham M. Kakade, Tong Zhang

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumption…

Time SeriesTime Series Analysis

Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Hidden Markov Models (HMMs) and Probabilistic Context-Free Grammars (PCFGs) are widely used structured models, both of which can be represented as factor graph grammars (FGGs), a powerful formalism capable of describing …

Language ModelingLanguage Modelling