Minimum Volume Topic Modeling
We propose a new topic modeling procedure that takes advantage of the fact that the Latent Dirichlet Allocation (LDA) log likelihood function is asymptotically equivalent to the logarithm of the volume of the topic simplex. This allows topic modeling to be reformulated as finding the probability simplex that minimizes its volume and encloses the documents that are represented as distributions over words. A convex relaxation of the minimum volume topic model optimization is proposed, and it is shown that the relaxed problem has the same global minimum as the original problem under the separability assumption and the sufficiently scattered assumption introduced by Arora et al. (2013) and Huang et al. (2016). A locally convergent alternating direction method of multipliers (ADMM) approach is introduced for solving the relaxed minimum volume problem. Numerical experiments illustrate the benefits of our approach in terms of computation time and topic recovery performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Model OptimizationSimilar Papers 제목 키워드 기반
Dual Simplex Volume Maximization for Simplex-Structured Matrix Factorization
Simplex-structured matrix factorization (SSMF) is a generalization of nonnegative matrix factorization, a fundamental interpretable data analysis model, and has applications in hyperspectral unmixing and topic modeling. …
Hyperspectral UnmixingRobustness of Minimum-Volume Nonnegative Matrix Factorization under an Expanded Sufficiently Scattered Condition
Minimum-volume nonnegative matrix factorization (min-vol NMF) has been used successfully in many applications, such as hyperspectral imaging, chemical kinetics, spectroscopy, topic modeling, and audio source separation. …
Audio Source SeparationA Semantic Cover Approach for Topic Modeling
We introduce a novel topic modeling approach based on constructing a semantic set cover for clusters of similar documents. Specifically, our approach first clusters documents using their Tf-Idf representation, and then c…
Document ClassificationGeneral ClassificationSemantic SimilaritySemantic Textual SimilarityThe impact of surface area, volume, curvature and Lennard-Jones potential to solvation modeling
This paper explores the impact of surface area, volume, curvature and Lennard-Jones potential on solvation free energy predictions. Rigidity surfaces are utilized to generate robust analytical expressions for maximum, mi…
Merging Embedded Topics with Optimal Transport for Online Topic Modeling on Data Streams
Topic modeling is a key component in unsupervised learning, employed to identify topics within a corpus of textual data. The rapid growth of social media generates an ever-growing volume of textual data daily, making onl…
Change Point Detection