Topic Analysis for Text with Side Data
Although latent factor models (e.g., matrix factorization) obtain good performance in predictions, they suffer from several problems including cold-start, non-transparency, and suboptimal recommendations. In this paper, we employ text with side data to tackle these limitations. We introduce a hybrid generative probabilistic model that combines a neural network with a latent topic model, which is a four-level hierarchical Bayesian model. In the model, each document is modeled as a finite mixture over an underlying set of topics and each topic is modeled as an infinite mixture over an underlying set of topic probabilities. Furthermore, each topic probability is modeled as a finite mixture over side data. In the context of text, the neural network provides an overview distribution about side data for the corresponding text, which is the prior distribution in LDA to help perform topic grouping. The approach is evaluated on several different datasets, where the model is shown to outperform standard LDA and Dirichlet-multinomial regression (DMR) in terms of topic grouping, model perplexity, classification and comment generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Comment GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AOBTM: Adaptive Online Biterm Topic Modeling for Version Sensitive Short-texts Analysis
Analysis of mobile app reviews has shown its important role in requirement engineering, software maintenance and evolution of mobile apps. Mobile app developers check their users' reviews frequently to clarify the issues…
Topic ModelsAOBTM: Adaptive Online Biterm Topic Modeling Method for Version Sensitive Short-texts Analysis
Analysis of mobile app reviews has shown its important role in requirement engineering, software maintenance, and the evolution of mobile apps. Mobile app developers check their users’ reviews frequently to clarify the i…
Topic ModelsPromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Models
The proliferation of social media has given rise to a new form of communication: memes. Memes are multimodal and often contain a combination of text and visual elements that convey meaning, humor, and cultural significan…
DescriptiveLanguage ModelingLanguage ModellingTILM: Neural Language Models with Evolving Topical Influence
Content of text data are often influenced by contextual factors which often evolve over time (e.g., content of social media are often influenced by topics covered in the major news streams). Existing language models do n…
Language ModelingLanguage ModellingGold-standard for Topic-specific Sentiment Analysis of Economic Texts
Public opinion, as measured by media sentiment, can be an important indicator in the financial and economic context. These are domains where traditional sentiment estimation techniques often struggle, and existing annota…
SentenceSentiment Analysis