paper-with-me

Papers

Interactive Topic Models with Optimal Transport

2024-06-28 · Garima Dhanania, Sheshera Mysore, Chau Minh Pham, Mohit Iyyer, Hamed Zamani, Andrew McCallum

Topic models are widely used to analyze document collections. While they are valuable for discovering latent topics in a corpus when analysts are unfamiliar with the corpus, analysts also commonly start with an understanding of the content present in a corpus. This may be through categories obtained from an initial pass over the corpus or a desire to analyze the corpus through a predefined set of categories derived from a high level theoretical framework (e.g. political ideology). In these scenarios analysts desire a topic modeling approach which incorporates their understanding of the corpus while supporting various forms of interaction with the model. In this work, we present EdTM, as an approach for label name supervised topic modeling. EdTM models topic modeling as an assignment problem while leveraging LM/LLM based document-topic affinities and using optimal transport for making globally coherent topic-assignments. In experiments, we show the efficacy of our framework compared to few-shot LLM classifiers, and topic models based on clustering and LDA. Further, we show EdTM's ability to incorporate various forms of analyst feedback and while remaining robust to noisy analyst inputs.

📄 PDF Abstract BibTeX arXiv:2406.19928

Code (0)

등록된 구현이 없습니다.

Tasks

Topic Models

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
LDA Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in…

Similar Papers 제목 키워드 기반

OTLDA: A Geometry-aware Optimal Transport Approach for Topic Modeling

2020-12-01 · NeurIPS 2020 12 · Viet Huynh, He Zhao, Dinh Phung

We present an optimal transport framework for learning topics from textual data. While the celebrated Latent Dirichlet allocation (LDA) topic model and its variants have been applied to many disciplines, they mainly focu…

vONTSS: vMF based semi-supervised neural topic modeling with optimal transport

2023-07-03 · Weijie Xu, Xiaoyu Jiang, Srinivasan H. Sengamedu, Francis Iannacci 외

Recently, Neural Topic Models (NTM), inspired by variational autoencoders, have attracted a lot of research interest; however, these methods have limited applications in the real world due to the challenge of incorporati…

ClassificationDiversitytext-classificationText Classification+2

Hierarchical Optimal Transport for Document Representation

2019-06-26 · NeurIPS 2019 12 · Mikhail Yurochkin, Sebastian Claici, Edward Chien, Farzaneh Mirzazadeh 외

The ability to measure similarity between documents enables intelligent summarization and analysis of large corpora. Past distances between documents suffer from either an inability to incorporate semantic similarities b…

Characterizing visual cortical magnification with topological smoothing and optimal transportation

2024-04-09 · Yujian Xiong, Yanshuai Tu, Zhong-Lin Lu, Yalin Wang

Human vision has different concentration on visual fields. Cortical magnification factor (CMF) is a popular measurement on visual acuity and cortex concentration. In order to achieve thorough measurement of CMF across th…

Merging Embedded Topics with Optimal Transport for Online Topic Modeling on Data Streams

2025-04-10 · Federica Granese, Benjamin Navet, Serena Villata, Charles Bouveyron

Topic modeling is a key component in unsupervised learning, employed to identify topics within a corpus of textual data. The rapid growth of social media generates an ever-growing volume of textual data daily, making onl…

Change Point Detection