Experiments on Generalizability of BERTopic on Multi-Domain Short Text
Topic modeling is widely used for analytically evaluating large collections of textual data. One of the most popular topic techniques is Latent Dirichlet Allocation (LDA), which is flexible and adaptive, but not optimal for e.g. short texts from various domains. We explore how the state-of-the-art BERTopic algorithm performs on short multi-domain text and find that it generalizes better than LDA in terms of topic coherence and diversity. We further analyze the performance of the HDBSCAN clustering algorithm utilized by BERTopic and find that it classifies a majority of the documents as outliers. This crucial, yet overseen problem excludes too many documents from further analysis. When we replace HDBSCAN with k-Means, we achieve similar performance, but without outliers.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDiversityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multilingual transformer and BERTopic for short text topic modeling: The case of Serbian
This paper presents the results of the first application of BERTopic, a state-of-the-art topic modeling technique, to short text written in a morphologi-cally rich language. We applied BERTopic with three multilingual em…
BERTopic for Topic Modeling of Hindi Short Texts: A Comparative Study
As short text data in native languages like Hindi increasingly appear in modern media, robust methods for topic modeling on such data have gained importance. This study investigates the performance of BERTopic in modelin…
Document EmbeddingTopic ModelsA Comparative Evaluation of Structural Topic Models and BERTopic for Short, Open-Ended Survey Responses
Topic modeling in applied psychology increasingly spans two methodological traditions: probabilistic bag-of-words models and newer embedding-based approaches. Yet many evaluations of these methods rely on longer and clea…
Topic ModelsLimTopic: LLM-based Topic Modeling and Text Summarization for Analyzing Scientific Articles limitations
The limitations sections of scientific articles play a crucial role in highlighting the boundaries and shortcomings of research, thereby guiding future studies and improving research methods. Analyzing these limitations …
ArticlesPrompt EngineeringText SummarizationEnhancing BERTopic with Intermediate Layer Representations
BERTopic is a topic modeling algorithm that leverages transformer-based embeddings to create dense clusters, enabling the estimation of topic structures and the extraction of valuable insights from a corpus of documents.…
Diversity