paper-with-me

홈 › Papers

HTMOT : Hierarchical Topic Modelling Over Time

2021-11-22 · Judicael Poumay, Ashwin Ittoo

Over the years, topic models have provided an efficient way of extracting insights from text. However, while many models have been proposed, none are able to model topic temporality and hierarchy jointly. Modelling time provide more precise topics by separating lexically close but temporally distinct topics while modelling hierarchy provides a more detailed view of the content of a document corpus. In this study, we therefore propose a novel method, HTMOT, to perform Hierarchical Topic Modelling Over Time. We train HTMOT using a new implementation of Gibbs sampling, which is more efficient. Specifically, we show that only applying time modelling to deep sub-topics provides a way to extract specific stories or events while high level topics extract larger themes in the corpus. Our results show that our training procedure is fast and can extract accurate high-level topics and temporally precise sub-topics. We measured our model's performance using the Word Intrusion task and outlined some limitations of this evaluation method, especially for hierarchical models. As a case study, we focused on the various developments in the space industry in 2020.

📄 PDF Abstract BibTeX arXiv:2112.03104

Code (0)

등록된 구현이 없습니다.

Tasks

Topic Models

Similar Papers 제목 키워드 기반

Nonparametric Bayesian Topic Modelling with the Hierarchical Pitman-Yor Processes

2016-09-22 · Kar Wai Lim, Wray Buntine, Changyou Chen, Lan Du

The Dirichlet process and its extension, the Pitman-Yor process, are stochastic processes that take probability distributions as a parameter. These processes can be stacked up to form a hierarchical nonparametric Bayesia…

Topic Models

A Light and Tuning-free Method for Simulating Camera Motion in Video Generation

2025-03-09 · Quanjian Song, Zhihang Lin, Zhanpeng Zeng, Ziyue Zhang 외

Existing camera motion-controlled video generation methods face computational bottlenecks in fine-tuning and inference. This paper proposes LightMotion, a light and tuning-free method for simulating camera motion in vide…

DenoisingDepth EstimationVideo Generation

On collapsed representation of hierarchical Completely Random Measures

2015-09-06 · Gaurav Pandey, Ambedkar Dukkipati

The aim of the paper is to provide an exact approach for generating a Poisson process sampled from a hierarchical CRM, without having to instantiate the infinitely many atoms of the random measures. We use completely ran…

Neural Attention-Aware Hierarchical Topic Model

2021-10-14 · EMNLP 2021 11 · Yuan Jin, He Zhao, Ming Liu, Lan Du 외

Neural topic models (NTMs) apply deep neural networks to topic modelling. Despite their success, NTMs generally ignore two important aspects: (1) only document-level word count information is utilized for the training, w…

modelSentenceTopic Models

Hierarchical Dirichlet process for tracking complex topical structure evolution and its application to autism research literature

2015-02-08 · Adham Beykikhoshk, Ognjen Arandjelovic, Dinh Phung, Svetha Venkatesh

In this paper we describe a novel framework for the discovery of the topical content of a data corpus, and the tracking of its complex structural changes across the temporal dimension. In contrast to previous work our mo…