paper-with-me

Papers

Exploring Topic-Metadata Relationships with the STM: A Bayesian Approach

2021-11-16 · ACL ARR November 2021 11 · Anonymous

The initial purpose of topic models was to identify latent topical clusters within unstructured text. Meanwhile, the focus of advanced studies has changed primarily to estimating the relationship between the discovered topical structure and theoretically relevant metadata. Methods used to estimate such relationships must take into account that the topical structure is not directly observed, but instead being estimated itself in an unsupervised fashion. In the Structural Topic Model (STM;Roberts et al., 2016), for instance, multiple repeated linear regressions of sampled topic proportions on metadata covariates are performed. This is done by using a Monte Carlo sampling technique known as the \textit{method of composition}. In this paper, we propose two modifications of this approach: First, we implement a substantial correction to the model by replacing linear regression with the more appropriate Beta regression. Second, we provide a fundamental enhancement of the entire estimation framework by substituting the current blending of frequentist and Bayesian methods with a fully Bayesian approach instead. This allows for a more appropriate quantification of uncertainty. We illustrate our improved methodology by investigating relationships between Twitter posts by German parliamentarians and different metadata covariates related to their electoral districts.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

regressionTopic Models

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

A Bayesian approach to modeling topic-metadata relationships

2021-04-06 · P. Schulze, S. Wiegrebe, P. W. Thurner, C. Heumann 외

The objective of advanced topic modeling is not only to explore latent topical structures, but also to estimate relationships between the discovered topics and theoretically relevant metadata. Methods used to estimate su…

regressionTopic Models

Minimally Supervised Categorization of Text with Metadata

2020-05-01 · Yu Zhang, Yu Meng, Jiaxin Huang, Frank F. Xu 외

Document categorization, which aims to assign a topic label to each document, plays a fundamental role in a wide variety of applications. Despite the success of existing studies in conventional supervised document classi…

Document Classification

Modeling Online Discourse with Coupled Distributed Topics

2018-09-19 · EMNLP 2018 10 · Nikita Srivatsan, Zachary Wojtowicz, Taylor Berg-Kirkpatrick

In this paper, we propose a deep, globally normalized topic model that incorporates structural relationships connecting documents in socially generated corpora, such as online forums. Our model (1) captures discursive in…

GPU

Graph Topic Modeling for Documents with Spatial or Covariate Dependencies

2024-12-19 · Yeo Jin Jung, Claire Donnat

We address the challenge of incorporating document-level metadata into topic modeling to improve topic mixture estimation. To overcome the computational complexity and lack of theoretical guarantees in existing Bayesian …

Authorless Topic Models: Biasing Models Away from Known Structure

2018-08-01 · COLING 2018 8 · Laure Thompson, David Mimno

Most previous work in unsupervised semantic modeling in the presence of metadata has assumed that our goal is to make latent dimensions more correlated with metadata, but in practice the exact opposite is often true. Som…

Document ClassificationTopic ModelsWord Embeddings