paper-with-me

Papers

Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithms

2024-09-30 · Melkamu Abay Mersha, Mesay Gemeda Yigezu, Jugal Kalita

Topic modeling is a powerful technique to discover hidden topics and patterns within a collection of documents without prior knowledge. Traditional topic modeling and clustering-based techniques encounter challenges in capturing contextual semantic information. This study introduces an innovative end-to-end semantic-driven topic modeling technique for the topic extraction process, utilizing advanced word and document embeddings combined with a powerful clustering algorithm. This semantic-driven approach represents a significant advancement in topic modeling methodologies. It leverages contextual semantic information to extract coherent and meaningful topics. Specifically, our model generates document embeddings using pre-trained transformer-based language models, reduces the dimensions of the embeddings, clusters the embeddings based on semantic similarity, and generates coherent topics for each cluster. Compared to ChatGPT and traditional topic modeling algorithms, our model provides more coherent and meaningful topics.

📄 PDF Abstract BibTeX arXiv:2410.00134

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringSemantic SimilaritySemantic Textual Similarity

Similar Papers 제목 키워드 기반

News Aggregation with Diverse Viewpoint Identification Using Neural Embeddings and Semantic Understanding Models

2020-12-01 · COLING (ArgMining) 2020 12 · Mark Carlebach, Ria Cheruvu, Brandon Walker, Cesar Ilharco Magalhaes 외

Today’s news volume makes it impractical for readers to get a diverse and comprehensive view of published articles written from opposing viewpoints. We introduce a transformer-based news aggregation system, composed of t…

ArticlesClusteringNatural Language InferenceSemantic Similarity+1

FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic Model

2024-05-28 · Xiaobao Wu, Thong Nguyen, Delvin Ce Zhang, William Yang Wang 외

Topic models have been evolving rapidly over the years, from conventional to recent neural models. However, existing topic models generally struggle with either effectiveness, efficiency, or stability, highly impeding th…

RelationTopic ModelsWord Embeddings

Semantic-Driven Topic Modeling for Analyzing Creativity in Virtual Brainstorming

2025-09-20 · Melkamu Abay Mersha, Jugal Kalita arxiv

Virtual brainstorming sessions have become a central component of collaborative problem solving, yet the large volume and uneven distribution of ideas often make it difficult to extract valuable insights efficiently. Man…

Dimensionality ReductionSemantic Similarity

HAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling

2025-05-12 · Hajar Sakai, Sarah S. Lam

Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (L…

Topic Models

$S^3$ -- Semantic Signal Separation

2024-06-13 · Márton Kardos, Jan Kostkan, Arnault-Quentin Vermillet, Kristoffer Nielbo 외

Topic models are useful tools for discovering latent semantic structures in large textual corpora. Recent efforts have been oriented at incorporating contextual representations in topic modeling and have been shown to ou…

blind source separationTopic Models