DOLDA - a regularized supervised topic model for high-dimensional multi-class regression
Generating user interpretable multi-class predictions in data rich environments with many classes and explanatory covariates is a daunting task. We introduce Diagonal Orthant Latent Dirichlet Allocation (DOLDA), a supervised topic model for multi-class classification that can handle both many classes as well as many covariates. To handle many classes we use the recently proposed Diagonal Orthant (DO) probit model (Johndrow et al., 2013) together with an efficient Horseshoe prior for variable selection/shrinkage (Carvalho et al., 2010). We propose a computationally efficient parallel Gibbs sampler for the new model. An important advantage of DOLDA is that learned topics are directly connected to individual classes without the need for a reference class. We evaluate the model's predictive accuracy on two datasets and demonstrate DOLDA's advantage in interpreting the generated predictions.
Code (1)
Tasks
General ClassificationMulti-class ClassificationregressionVariable SelectionSimilar Papers 제목 키워드 기반
High-Dimensional Tail Index Regression: with An Application to Text Analyses of Viral Posts in Social Media
Motivated by the empirical observation of power-law distributions in the credits (e.g., "likes") of viral social media posts, we introduce a high-dimensional tail index regression model and propose methods for estimation…
Limbic: Author-Based Sentiment Aspect Modeling Regularized with Word Embeddings and Discourse Relations
We propose Limbic, an unsupervised probabilistic model that addresses the problem of discovering aspects and sentiments and associating them with authors of opinionated texts. Limbic combines three ideas, incorporating a…
DiversityGeneral ClassificationSemantic SimilaritySemantic Textual Similarity+4Prediction-Constrained Training for Semi-Supervised Mixture and Topic Models
Supervisory signals have the potential to make low-dimensional data representations, like those learned by mixture and topic models, more interpretable and useful. We propose a framework for training latent variable mode…
PredictionSentiment AnalysisTopic ModelsGraph Regularized Autoencoder and its Application in Unsupervised Anomaly Detection
Dimensionality reduction is a crucial first step for many unsupervised learning tasks including anomaly detection and clustering. Autoencoder is a popular mechanism to accomplish dimensionality reduction. In order to mak…
Anomaly DetectionClusteringDimensionality ReductionUnsupervised Anomaly DetectionSurvival-Supervised Topic Modeling with Anchor Words: Characterizing Pancreatitis Outcomes
We introduce a new approach for topic modeling that is supervised by survival analysis. Specifically, we build on recent work on unsupervised topic modeling with so-called anchor words by providing supervision through an…
Survival Analysis