Efficient Sparse Spherical k-Means for Document Clustering
Spherical k-Means is frequently used to cluster document collections because it performs reasonably well in many settings and is computationally efficient. However, the time complexity increases linearly with the number of clusters k, which limits the suitability of the algorithm for larger values of k depending on the size of the collection. Optimizations targeted at the Euclidean k-Means algorithm largely do not apply because the cosine distance is not a metric. We therefore propose an efficient indexing structure to improve the scalability of Spherical k-Means with respect to k. Our approach exploits the sparsity of the input vectors and the convergence behavior of k-Means to reduce the number of comparisons on each iteration significantly.
Code (1)
Tasks
ClusteringShort Text ClusteringText ClusteringUnsupervised Spatial ClusteringSimilar Papers 제목 키워드 기반
Accelerating Spherical k-Means
Spherical k-means is a widely used clustering algorithm for sparse and high-dimensional data such as document vectors. While several improvements and accelerations have been introduced for the original k-means algorithm,…
ClusteringComputational EfficiencyAccelerating spherical K-means clustering for large-scale sparse document data
This paper presents an accelerated spherical K-means clustering algorithm for large-scale and high-dimensional sparse document data sets. We design an algorithm working in an architecture-friendly manner (AFM), which is …
ClusteringAmharic Text Clustering Using Encyclopedic Knowledge with Neural Word Embedding
In this digital era, almost in every discipline people are using automated systems that generate information represented in document format in different natural languages. As a result, there is a growing interest towards…
ClusteringText ClusteringMerging $K$-means with hierarchical clustering for identifying general-shaped groups
Clustering partitions a dataset such that observations placed together in a group are similar but different from those in other groups. Hierarchical and $K$-means clustering are two approaches but have different strength…
ClusteringDensity EstimationSpeech SynthesisText Mining using Nonnegative Matrix Factorization and Latent Semantic Analysis
Text clustering is arguably one of the most important topics in modern data mining. Nevertheless, text data require tokenization which usually yields a very large and highly sparse term-document matrix, which is usually …
ClusteringMatrix Factorization / DecompositionText Clustering