paper-with-me

Papers

Prompting Large Language Models for Topic Modeling

2023-12-15 · Han Wang, Nirmalendu Prakash, Nguyen Khoi Hoang, Ming Shan Hee, Usman Naseem, Roy Ka-Wei Lee

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data. However, existing models have certain limitations, particularly when dealing with short text datasets that lack co-occurring words. Moreover, these models often neglect sentence-level semantics, focusing primarily on token-level semantics. In this paper, we propose PromptTopic, a novel topic modeling approach that harnesses the advanced language understanding of large language models (LLMs) to address these challenges. It involves extracting topics at the sentence level from individual documents, then aggregating and condensing these topics into a predefined quantity, ultimately providing coherent topics for texts of varying lengths. This approach eliminates the need for manual parameter tuning and improves the quality of extracted topics. We benchmark PromptTopic against the state-of-the-art baselines on three vastly diverse datasets, establishing its proficiency in discovering meaningful topics. Furthermore, qualitative analysis showcases PromptTopic's ability to uncover relevant topics in multiple datasets.

📄 PDF Abstract BibTeX arXiv:2312.09693

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Similar Papers 제목 키워드 기반

Investigating the Impact of Text Summarization on Topic Modeling

2024-09-28 · Trishia Khandelwal

Topic models are used to identify and group similar themes in a set of documents. Recent advancements in deep learning based neural topic models has received significant research interest. In this paper, an approach is p…

DiversityLanguage ModelingLanguage ModellingLarge Language Model+2

Using Zero-shot Prompting in the Automatic Creation and Expansion of Topic Taxonomies for Tagging Retail Banking Transactions

2024-01-08 · Daniel de S. Moraes, Pedro T. C. Santos, Polyana B. da Costa, Matheus A. S. Pinto 외

This work presents an unsupervised method for automatically constructing and expanding topic taxonomies using instruction-based fine-tuned LLMs (Large Language Models). We apply topic modeling and keyword extraction tech…

Keyword Extraction

Human-Centric Topic Modeling with Goal-Prompted Contrastive Learning and Optimal Transport

2026-04-14 · Rui Wang, Yi Zheng, Dongxin Wang, Haiping Huang 외 arxiv

Existing topic modeling methods, from LDA to recent neural and LLM-based approaches, which focus mainly on statistical coherence, often produce redundant or off-target topics that miss the user's underlying intent. We in…

Contrastive Learning

A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models

2023-07-24 · Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami 외

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instru…

Image GenerationImage-text matchingLanguage ModelingLanguage Modelling+5

RecPrompt: A Self-tuning Prompting Framework for News Recommendation Using Large Language Models

2023-12-16 · Dairui Liu, Boming Yang, Honghui Du, Derek Greene 외

News recommendations heavily rely on Natural Language Processing (NLP) methods to analyze, understand, and categorize content, enabling personalized suggestions based on user interests and reading behaviors. Large Langua…

News RecommendationPrompt EngineeringRecommendation Systems