paper-with-me

Papers

Combinatorial Topic Models using Small-Variance Asymptotics

2016-04-07 · Ke Jiang, Suvrit Sra, Brian Kulis

Topic models have emerged as fundamental tools in unsupervised machine learning. Most modern topic modeling algorithms take a probabilistic view and derive inference algorithms based on Latent Dirichlet Allocation (LDA) or its variants. In contrast, we study topic modeling as a combinatorial optimization problem, and propose a new objective function derived from LDA by passing to the small-variance limit. We minimize the derived objective by using ideas from combinatorial optimization, which results in a new, fast, and high-quality topic modeling algorithm. In particular, we show that our results are competitive with popular LDA-based topic modeling approaches, and also discuss the (dis)similarities between our approach and its probabilistic counterparts.

📄 PDF Abstract BibTeX arXiv:1604.02027

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationTopic Models

Methods 이 논문이 사용한 방법론

LDA Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in…

Similar Papers 제목 키워드 기반

Small-Variance Asymptotics for Hidden Markov Models

2013-12-01 · NeurIPS 2013 12 · Anirban Roychowdhury, Ke Jiang, Brian Kulis

Small-variance asymptotics provide an emerging technique for obtaining scalable combinatorial algorithms from rich probabilistic models. We present a small-variance asymptotic analysis of the Hidden Markov Model and its …

Small-Variance Asymptotics for Exponential Family Dirichlet Process Mixture Models

2012-12-01 · NeurIPS 2012 12 · Ke Jiang, Brian Kulis, Michael. I. Jordan

Links between probabilistic and non-probabilistic learning algorithms can arise by performing small-variance asymptotics, i.e., letting the variance of particular distributions in a graphical model go to zero. For instan…

Clustering

Detailed Derivations of Small-Variance Asymptotics for some Hierarchical Bayesian Nonparametric Models

2014-12-31 · Jonathan H. Huggins, Ardavan Saeedi, Matthew J. Johnson

In this note we provide detailed derivations of two versions of small-variance asymptotics for hierarchical Dirichlet process (HDP) mixture models and the HDP hidden Markov model (HDP-HMM, a.k.a. the infinite HMM). We in…

JUMP-Means: Small-Variance Asymptotics for Markov Jump Processes

2015-03-01 · Jonathan H. Huggins, Karthik Narasimhan, Ardavan Saeedi, Vikash K. Mansinghka

Markov jump processes (MJPs) are used to model a wide range of phenomena from disease progression to RNA path folding. However, maximum likelihood estimation of parametric models leads to degenerate trajectories and infe…

A note on the option price and 'Mass at zero in the uncorrelated SABR model and implied volatility asymptotics'

2020-11-01 · Jaehyuk Choi, Lixin Wu

Gulisashvili et al. [Quant. Finance, 2018, 18(10), 1753-1765] provide a small-time asymptotics for the mass at zero under the uncorrelated stochastic-alpha-beta-rho (SABR) model by approximating the integrated variance w…

MathNumerical Integration