An Online Semantic-enhanced Dirichlet Model for Short Text Stream Clustering
Clustering short text streams is a challenging task due to its unique properties: infinite length, sparse data representation and cluster evolution. Existing approaches often exploit short text streams in a batch way. However, determine the optimal batch size is usually a difficult task since we have no priori knowledge when the topics evolve. In addition, traditional independent word representation in graphical model tends to cause {``}term ambiguity{''} problem in short text clustering. Therefore, in this paper, we propose an Online Semantic-enhanced Dirichlet Model for short sext stream clustering, called OSDM, which integrates the word-occurance semantic information (i.e., context) into a new graphical model and clusters each arriving short text automatically in an online way. Extensive results have demonstrated that OSDM has better performance compared to many state-of-the-art algorithms on both synthetic and real-world data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringShort Text ClusteringText ClusteringSimilar Papers 제목 키워드 기반
Short Text Classification Improved by Feature Space Extension
With the explosive development of mobile Internet, short text has been applied extensively. The difference between classifying short text and long documents is that short text is of shortness and sparsity. Thus, it is ch…
ClassificationGeneral Classificationtext-classificationText ClassificationBag of biterms modeling for short texts
Analyzing texts from social media encounters many challenges due to their unique characteristics of shortness, massiveness, and dynamic. Short texts do not provide enough context information, causing the failure of the t…
AOBTM: Adaptive Online Biterm Topic Modeling Method for Version Sensitive Short-texts Analysis
Analysis of mobile app reviews has shown its important role in requirement engineering, software maintenance, and the evolution of mobile apps. Mobile app developers check their users’ reviews frequently to clarify the i…
Topic ModelsBERTopic for Topic Modeling of Hindi Short Texts: A Comparative Study
As short text data in native languages like Hindi increasingly appear in modern media, robust methods for topic modeling on such data have gained importance. This study investigates the performance of BERTopic in modelin…
Document EmbeddingTopic ModelsOTLDA: A Geometry-aware Optimal Transport Approach for Topic Modeling
We present an optimal transport framework for learning topics from textual data. While the celebrated Latent Dirichlet allocation (LDA) topic model and its variants have been applied to many disciplines, they mainly focu…