Supervised Topic Models
We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which relies on variational methods to handle intractable posterior expectations. Prediction problems motivate this research: we use the fitted model to predict response values for new documents. We test sLDA on two real-world problems: movie ratings predicted from reviews, and the political tone of amendments in the U.S. Senate based on the amendment text. We illustrate the benefits of sLDA versus modern regularized regression, as well as versus an unsupervised LDA analysis followed by a separate regression.
Code (1)
Tasks
parameter estimationregressionTopic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Topic Coverage Approach to Evaluation of Topic Models
Topic models are widely used unsupervised models capable of learning topics - weighted lists of words and documents - from large collections of text documents. When topic models are used for discovery of topics in text c…
Topic coverageTopic ModelsA Bayesian Topic Model for Human-Evaluated Interpretability
One desiderata of topic modeling is to produce interpretable topics. Given a cluster of document-tokens comprising a topic, we can order the topic by counting each word. It is natural to think that each topic could easil…
Topic ModelsvONTSS: vMF based semi-supervised neural topic modeling with optimal transport
Recently, Neural Topic Models (NTM), inspired by variational autoencoders, have attracted a lot of research interest; however, these methods have limited applications in the real world due to the challenge of incorporati…
ClassificationDiversitytext-classificationText Classification+2Siamese Network-Based Supervised Topic Modeling
Label-specific topics can be widely used for supporting personality psychology, aspect-level sentiment analysis, and cross-domain sentiment classification. To generate label-specific topics, several supervised topic mode…
General ClassificationSentiment AnalysisSentiment ClassificationTopic Models+1Human in the loop: How to effectively create coherent topics by manually labeling only a few documents per class
Few-shot methods for accurate modeling under sparse label-settings have improved significantly. However, the applications of few-shot modeling in natural language processing remain solely in the field of document classif…
Document ClassificationFew-Shot Learning