Nonparametric Forest-Structured Neural Topic Modeling
Neural topic models have been widely used in discovering the latent semantics from a corpus. Recently, there are several researches on hierarchical neural topic models since the relationships among topics are valuable for data analysis and exploration. However, the existing hierarchical neural topic models are limited to generate a single topic tree. In this study, we present a nonparametric forest-structured neural topic model by firstly applying the self-attention mechanism to capture parent-child topic relationships, and then build a sparse directed acyclic graph to form a topic forest. Experiments indicate that our model can automatically learn a forest-structured topic hierarchy with indefinite numbers of trees and leaves, and significantly outperforms the baseline models on topic hierarchical rationality and affinity.
Code (2)
Tasks
Topic ModelsSimilar Papers 제목 키워드 기반
Tree-Structured Topic Modeling with Nonparametric Neural Variational Inference
Topic modeling has been widely used for discovering the latent semantic structure of documents, but most existing methods learn topics with a flat structure. Although probabilistic models can generate topic hierarchies b…
Variational InferenceTwitter-Network Topic Model: A Full Bayesian Treatment for Social Network and Text Modeling
Twitter data is extremely noisy -- each tweet is short, unstructured and with informal language, a challenge for current topic modeling. On the other hand, tweets are accompanied by extra information such as authorship, …
Topic ModelsA Bayesian Topic Model for Human-Evaluated Interpretability
One desiderata of topic modeling is to produce interpretable topics. Given a cluster of document-tokens comprising a topic, we can order the topic by counting each word. It is natural to think that each topic could easil…
Topic ModelsBayesian Nonparametrics in Topic Modeling: A Brief Tutorial
Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachi…
Anomaly Detection in Unstructured Environments using Bayesian Nonparametric Scene Modeling
This paper explores the use of a Bayesian non-parametric topic modeling technique for the purpose of anomaly detection in video data. We present results from two experiments. The first experiment shows that the proposed …
Anomaly Detection