Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithms
Topic modeling is a powerful technique to discover hidden topics and patterns within a collection of documents without prior knowledge. Traditional topic modeling and clustering-based techniques encounter challenges in capturing contextual semantic information. This study introduces an innovative end-to-end semantic-driven topic modeling technique for the topic extraction process, utilizing advanced word and document embeddings combined with a powerful clustering algorithm. This semantic-driven approach represents a significant advancement in topic modeling methodologies. It leverages contextual semantic information to extract coherent and meaningful topics. Specifically, our model generates document embeddings using pre-trained transformer-based language models, reduces the dimensions of the embeddings, clusters the embeddings based on semantic similarity, and generates coherent topics for each cluster. Compared to ChatGPT and traditional topic modeling algorithms, our model provides more coherent and meaningful topics.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringSemantic SimilaritySemantic Textual SimilaritySimilar Papers 제목 키워드 기반
News Aggregation with Diverse Viewpoint Identification Using Neural Embeddings and Semantic Understanding Models
Today’s news volume makes it impractical for readers to get a diverse and comprehensive view of published articles written from opposing viewpoints. We introduce a transformer-based news aggregation system, composed of t…
ArticlesClusteringNatural Language InferenceSemantic Similarity+1FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic Model
Topic models have been evolving rapidly over the years, from conventional to recent neural models. However, existing topic models generally struggle with either effectiveness, efficiency, or stability, highly impeding th…
RelationTopic ModelsWord EmbeddingsSemantic-Driven Topic Modeling for Analyzing Creativity in Virtual Brainstorming
Virtual brainstorming sessions have become a central component of collaborative problem solving, yet the large volume and uneven distribution of ideas often make it difficult to extract valuable insights efficiently. Man…
Dimensionality ReductionSemantic SimilarityHAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling
Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (L…
Topic Models$S^3$ -- Semantic Signal Separation
Topic models are useful tools for discovering latent semantic structures in large textual corpora. Recent efforts have been oriented at incorporating contextual representations in topic modeling and have been shown to ou…
blind source separationTopic Models