Integrating Document Clustering and Topic Modeling
Document clustering and topic modeling are two closely related tasks which can mutually benefit each other. Topic modeling can project documents into a topic space which facilitates effective document clustering. Cluster labels discovered by document clustering can be incorporated into topic models to extract local topics specific to each cluster and global topics shared by all clusters. In this paper, we propose a multi-grain clustering topic model (MGCTM) which integrates document clustering and topic modeling into a unified framework and jointly performs the two tasks to achieve the overall best performance. Our model tightly couples two components: a mixture component used for discovering latent groups in document collection and a topic model component used for mining multi-grain topics including local topics specific to each cluster and global topics shared across clusters.We employ variational inference to approximate the posterior of hidden variables and learn model parameters. Experiments on two datasets demonstrate the effectiveness of our model.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringTopic ModelsVariational InferenceSimilar Papers 제목 키워드 기반
Coherence-Based Document Clustering
Latent Dirichlet Allocation or Non-negative Matrix Factorization are just two widely used algorithms for extracting latent topics from large text corpora. While these algorithms differ in their modeling approach, they ha…
ClusteringHyperparameter OptimizationKeyword ExtractionSemantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithms
Topic modeling is a powerful technique to discover hidden topics and patterns within a collection of documents without prior knowledge. Traditional topic modeling and clustering-based techniques encounter challenges in c…
ClusteringSemantic SimilaritySemantic Textual SimilarityBERTopic: Neural topic modeling with a class-based TF-IDF procedure
Topic models can be useful tools to discover latent topics in collections of documents. Recent studies have shown the feasibility of approach topic modeling as a clustering task. We present BERTopic, a topic model that e…
ClusteringDocument EmbeddingTopic ModelsFLATM: A Fuzzy Logic Approach Topic Model for Medical Documents
One of the challenges for text analysis in medical domains is analyzing large-scale medical documents. As a consequence, finding relevant documents has become more difficult. One of the popular methods to retrieve inform…
ClusteringDocument ClassificationTopic ModelsBATS: A Spectral Biclustering Approach to Single Document Topic Modeling and Segmentation
Existing topic modeling and text segmentation methodologies generally require large datasets for training, limiting their capabilities when only small collections of text are available. In this work, we reexamine the int…
DiversitySegmentationText SegmentationTopic Models