Topic representation: finding more representative words in topic models
The top word list, i.e., the top-M words with highest marginal probability in a given topic, is the standard topic representation in topic models. Most of recent automatical topic labeling algorithms and popular topic quality metrics are based on it. However, we find, empirically, words in this type of top word list are not always representative. The objective of this paper is to find more representative top word lists for topics. To achieve this, we rerank the words in a given topic by further considering marginal probability on words over every other topic. The reranking list of top-M words is used to be a novel topic representation for topic models. We investigate three reranking methodologies, using (1) standard deviation weight, (2) standard deviation weight with topic size and (3) Chi Square \c{hi}2statistic selection. Experimental results on real world collections indicate that our representations can extract more representative words for topics, agreeing with human judgements.
Code (0)
등록된 구현이 없습니다.
Tasks
RerankingTopic ModelsSimilar Papers 제목 키워드 기반
Top2Vec: Distributed Representations of Topics
Topic modeling is used for discovering latent semantic structure, usually referred to as topics, in a large collection of documents. The most widely used methods are Latent Dirichlet Allocation and Probabilistic Latent S…
LemmatizationSemantic SimilaritySemantic Textual SimilarityTopic ModelsNeuroMax: Enhancing Neural Topic Modeling via Maximizing Mutual Information and Group Topic Regularization
Recent advances in neural topic models have concentrated on two primary directions: the integration of the inference network (encoder) with a pre-trained language model (PLM) and the modeling of the relationship between …
DecoderLanguage ModelingLanguage ModellingTopic ModelsClassifying Idiomatic and Literal Expressions Using Topic Models and Intensity of Emotions
We describe an algorithm for automatic classification of idiomatic and literal expressions. Our starting point is that words in a given text segment, such as a paragraph, that are highranking representatives of a common …
ClusteringOutlier DetectionTopic ModelsTopic Modelling Brazilian Supreme Court Lawsuits
The present work proposes the use of Latent Dirichlet Allocation to model Extraordinary Appeals received by Brazil’s Supreme Court. The data consist of a corpus of 45,532 lawsuits manually annotated by the Court’s expert…
Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONHAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling
Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (L…
Topic Models