Dirichlet Simplex Nest and Geometric Inference

2019-05-27 · Mikhail Yurochkin, Aritra Guha, Yuekai Sun, XuanLong Nguyen

We propose Dirichlet Simplex Nest, a class of probabilistic models suitable for a variety of data types, and develop fast and provably accurate inference algorithms by accounting for the model's convex geometry and low dimensional simplicial structure. By exploiting the connection to Voronoi tessellation and properties of Dirichlet distribution, the proposed inference algorithm is shown to achieve consistency and strong error bound guarantees on a range of model settings and data distributions. The effectiveness of our model and the learning algorithm is demonstrated by simulations and by analyses of text and financial data.

📄 PDF Abstract BibTeX arXiv:1905.11009

Code (1)

moonfolk/VLAD 공식 구현

Nested Hierarchical Dirichlet Processes

2012-10-25 · John Paisley, Chong Wang, David M. Blei, Michael. I. Jordan

We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a to…

Variational Inference

Deep Latent Dirichlet Allocation with Topic-Layer-Adaptive Stochastic Gradient Riemannian MCMC

2017-06-06 · ICML 2017 8 · Yulai Cong, Bo Chen, Hongwei Liu, Mingyuan Zhou

It is challenging to develop stochastic gradient based scalable inference for deep discrete latent variable models (LVMs), due to the difficulties in not only computing the gradients, but also adapting the step sizes to …

Data Augmentation

Large-Scale Stochastic Sampling from the Probability Simplex

2018-06-19 · NeurIPS 2018 12 · Jack Baker, Paul Fearnhead, Emily B. Fox, Christopher Nemeth

Stochastic gradient Markov chain Monte Carlo (SGMCMC) has become a popular method for scalable Bayesian inference. These methods are based on sampling a discrete-time approximation to a continuous time process, such as t…

Bayesian Inference Topic Models

A New Distribution on the Simplex with Auto-Encoding Applications

2019-05-28 · NeurIPS 2019 12 · Andrew Stirn, Tony Jebara, David A. Knowles

We construct a new distribution for the simplex using the Kumaraswamy distribution and an ordered stick-breaking process. We explore and develop the theoretical properties of this new distribution and prove that it exhib…

Nested Hierarchical Dirichlet Processes for Multi-Level Non-Parametric Admixture Modeling

2015-08-26 · Lavanya Sita Tekumalla, Priyanka Agrawal, Indrajit Bhattacharya

Dirichlet Process(DP) is a Bayesian non-parametric prior for infinite mixture modeling, where the number of mixture components grows with the number of data items. The Hierarchical Dirichlet Process (HDP), is an extensio…

Clustering