Improving Topic Models with Latent Feature Word Representations
Probabilistic topic models are widely used to discover latent topics in document collections, while latent feature vector representations of words have been used to obtain high performance in many NLP tasks. In this paper, we extend two different Dirichlet multinomial topic models by incorporating latent feature vector representations of words trained on very large corpora to improve the word-topic mapping learnt on a smaller corpus. Experimental results show that by using information from the external corpora, our new models produce significant improvements on topic coherence, document clustering and document classification tasks, especially on datasets with few or short documents.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDocument ClassificationGeneral ClassificationTopic ModelsSimilar Papers 제목 키워드 기반
Improving Topic Coherence with Latent Feature Word Representations in MAP Estimation for Topic Modeling
Multi-view and Multi-source Transfers in Neural Topic Modeling with Pretrained Topic and Word Embeddings
Though word embeddings and topics are complementary representations, several past works have only used pre-trained word embeddings in (neural) topic modeling to address data sparsity problem in short text or small collec…
Information RetrievalRetrievalTransfer LearningWord EmbeddingsMulti-source Multi-view Transfer Learning in Neural Topic Modeling with Pretrained Topic and Word Embeddings
Though word embeddings and topics are complementary representations, several past works have only used pretrained word embeddings in (neural) topic modeling to address data sparsity problem in short text or small collect…
Information RetrievalRetrievalTransfer LearningWord EmbeddingsTopic2Vec: Learning Distributed Representations of Topics
Latent Dirichlet Allocation (LDA) mining thematic structure of documents plays an important role in nature language processing and machine learning areas. However, the probability distribution from LDA only describes the…
Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoders
Traditional topic models are effective at uncovering latent themes in large text collections. However, due to their reliance on bag-of-words representations, they struggle to capture semantically abstract features. While…
Text GenerationTopic Models