Multivariate Gaussian Document Representation from Word Embeddings for Text Categorization
Recently, there has been a lot of activity in learning distributed representations of words in vector spaces. Although there are models capable of learning high-quality distributed representations of words, how to generate vector representations of the same quality for phrases or documents still remains a challenge. In this paper, we propose to model each document as a multivariate Gaussian distribution based on the distributed representations of its words. We then measure the similarity between two documents based on the similarity of their distributions. Experiments on eight standard text categorization datasets demonstrate the effectiveness of the proposed approach in comparison with state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Text CategorizationWord EmbeddingsSimilar Papers 제목 키워드 기반
Gaussian Hierarchical Latent Dirichlet Allocation: Bringing Polysemy Back
Topic models are widely used to discover the latent representation of a set of documents. The two canonical models are latent Dirichlet allocation, and Gaussian latent Dirichlet allocation, where the former uses multinom…
Topic ModelsMultivariate Gaussian Topic Modelling: A novel approach to discover topics with greater semantic coherence
An important aspect of text mining involves information retrieval in form of discovery of semantic themes (topics) from documents using topic modelling. While generative topic models like Latent Dirichlet Allocation (LDA…
Information RetrievalTopic ModelsIntegrating Topic Modeling with Word Embeddings by Mixtures of vMFs
Gaussian LDA integrates topic modeling with word embeddings by replacing discrete topic distribution over word types with multivariate Gaussian distribution on the embedding space. This can take semantic information of w…
Topic ModelsWord EmbeddingsContext Reinforced Neural Topic Modeling over Short Texts
As one of the prevalent topic mining tools, neural topic modeling has attracted a lot of interests for the advantages of high efficiency in training and strong generalisation abilities. However, due to the lack of contex…
text-classificationText ClassificationTopic ModelsWord EmbeddingsUnsupervised POS Induction with Word Embeddings
Unsupervised word embeddings have been shown to be valuable as features in supervised learning problems; however, their role in unsupervised problems has been less thoroughly explored. In this paper, we show that embeddi…
POSWord Embeddings