ANTM: An Aligned Neural Topic Model for Exploring Evolving Topics
This paper presents an algorithmic family of dynamic topic models called Aligned Neural Topic Models (ANTM), which combine novel data mining algorithms to provide a modular framework for discovering evolving topics. ANTM maintains the temporal continuity of evolving topics by extracting time-aware features from documents using advanced pre-trained Large Language Models (LLMs) and employing an overlapping sliding window algorithm for sequential document clustering. This overlapping sliding window algorithm identifies a different number of topics within each time frame and aligns semantically similar document clusters across time periods. This process captures emerging and fading trends across different periods and allows for a more interpretable representation of evolving topics. Experiments on four distinct datasets show that ANTM outperforms probabilistic dynamic topic models in terms of topic coherence and diversity metrics. Moreover, it improves the scalability and flexibility of dynamic topic models by being accessible and adaptable to different types of algorithms. Additionally, a Python package is developed for researchers and scientists who wish to study the trends and evolving patterns of topics in large-scale textual data.
Code (1)
Tasks
DiversityDynamic Topic ModelingTopic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification
A large number of conflict events are affecting the world all the time. In order to analyse such conflict events effectively, this paper presents a Classification-Aware Neural Topic Model (CANTM-IA) for Conflict Informat…
ClassificationRecurrent Coupled Topic Modeling over Sequential Documents
The abundant sequential documents such as online archival, social media and news feeds are streamingly updated, where each chunk of documents is incorporated with smoothly evolving yet dependent topics. Such digital text…
Data AugmentationDynamic Topic ModelingDigital Health Discussion Through Articles Published Until the Year 2021: A Digital Topic Modeling Approach
The digital health industry has grown in popularity since the 2010s, but there has been limited analysis of the topics discussed in the field across academic disciplines. This study aims to analyze the research trends of…
ArticlesElectrical EngineeringTILM: Neural Language Models with Evolving Topical Influence
Content of text data are often influenced by contextual factors which often evolve over time (e.g., content of social media are often influenced by topics covered in the major news streams). Existing language models do n…
Language ModelingLanguage ModellingA Constrained Coupled Matrix-Tensor Factorization for Learning Time-evolving and Emerging Topics
Topic discovery has witnessed a significant growth as a field of data mining at large. In particular, time-evolving topic discovery, where the evolution of a topic is taken into account has been instrumental in understan…