paper-with-me

Papers

Topic Modelling: Going Beyond Token Outputs

2024-01-16 · Lowri Williams, Eirini Anthi, Laura Arman, Pete Burnap

Topic modelling is a text mining technique for identifying salient themes from a number of documents. The output is commonly a set of topics consisting of isolated tokens that often co-occur in such documents. Manual effort is often associated with interpreting a topic's description from such tokens. However, from a human's perspective, such outputs may not adequately provide enough information to infer the meaning of the topics; thus, their interpretability is often inaccurately understood. Although several studies have attempted to automatically extend topic descriptions as a means of enhancing the interpretation of topic models, they rely on external language sources that may become unavailable, must be kept up-to-date to generate relevant results, and present privacy issues when training on or processing data. This paper presents a novel approach towards extending the output of traditional topic modelling methods beyond a list of isolated tokens. This approach removes the dependence on external sources by using the textual data itself by extracting high-scoring keywords and mapping them to the topic model's token outputs. To measure the interpretability of the proposed outputs against those of the traditional topic modelling approach, independent annotators manually scored each output based on their quality and usefulness, as well as the efficiency of the annotation task. The proposed approach demonstrated higher quality and usefulness, as well as higher efficiency in the annotation task, in comparison to the outputs of a traditional topic modelling method, demonstrating an increase in their interpretability.

📄 PDF Abstract BibTeX arXiv:2401.12990

Code (0)

등록된 구현이 없습니다.

Tasks

Topic Models

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

CAST: Corpus-Aware Self-similarity Enhanced Topic modelling

2024-10-19 · Yanan Ma, Chenghao Xiao, Chenhan Yuan, Sabine N van der Veer 외

Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of docume…

Contrastive LearningDiversityWord Embeddings

Autoencoding Documents for Topic Modeling with L-2 Sparsity Regularization

2018-10-22 · Anonymous

We propose a novel yet simple neural network architecture for topic modelling. The method is based on training an autoencoder structure where the bottleneck represents the space of the topics distribution and the decoder…

Decoder

Moving Beyond LDA: A Comparison of Unsupervised Topic Modelling Techniques for Qualitative Data Analysis of Online Communities

2024-12-19 · Amandeep Kaur, James R. Wallace

Social media constitutes a rich and influential source of information for qualitative researchers. Although computational techniques like topic modelling assist with managing the volume and diversity of social media cont…

DiversityLanguage ModelingLanguage ModellingLarge Language Model

Topic Modeling with Topological Data Analysis

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Recent unsupervised topic modelling approaches that use clustering techniques on word, token or document embeddings can extract coherent topics. However, a common limitation of such approaches is that they reveal nothing…

ClusteringTopological Data AnalysisWord Embeddings

Context is Key(NMF): Modelling Topical Information Dynamics in Chinese Diaspora Media

2024-10-16 · Ross Deans Kristensen-McLachlan, Rebecca M. M. Hicke, Márton Kardos, Mette Thunø

Does the People's Republic of China (PRC) interfere with European elections through ethnic Chinese diaspora media? This question forms the basis of an ongoing research project exploring how PRC narratives about European …