paper-with-me

홈 › Papers

Linear, Deterministic, and Order-Invariant Initialization Methods for the K-Means Clustering Algorithm

2014-09-12 · M. Emre Celebi, Hassan A. Kingravi

Over the past five decades, k-means has become the clustering algorithm of choice in many application domains primarily due to its simplicity, time/space efficiency, and invariance to the ordering of the data points. Unfortunately, the algorithm's sensitivity to the initial selection of the cluster centers remains to be its most serious drawback. Numerous initialization methods have been proposed to address this drawback. Many of these methods, however, have time complexity superlinear in the number of data points, which makes them impractical for large data sets. On the other hand, linear methods are often random and/or sensitive to the ordering of the data points. These methods are generally unreliable in that the quality of their results is unpredictable. Therefore, it is common practice to perform multiple runs of such methods and take the output of the run that produces the best results. Such a practice, however, greatly increases the computational requirements of the otherwise highly efficient k-means algorithm. In this chapter, we investigate the empirical performance of six linear, deterministic (non-random), and order-invariant k-means initialization methods on a large and diverse collection of data sets from the UCI Machine Learning Repository. The results demonstrate that two relatively unknown hierarchical initialization methods due to Su and Dy outperform the remaining four methods with respect to two objective effectiveness criteria. In addition, a recent method due to Erisoglu et al. performs surprisingly poorly.

📄 PDF Abstract BibTeX arXiv:1409.3854

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Deterministic Initialization of the K-Means Algorithm Using Hierarchical Clustering

2013-04-28 · M. Emre Celebi, Hassan A. Kingravi

K-means is undoubtedly the most widely used partitional clustering algorithm. Unfortunately, due to its gradient descent nature, this algorithm is highly sensitive to the initial placement of the cluster centers. Numerou…

Clustering

Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization

2022-07-20 · Kabir Aladin Chandrasekher, Mengqi Lou, Ashwin Pananjady

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the non…

Stochastic Model Predictive Control for Linear Systems with Unbounded Additive Uncertainties

2021-04-21 · Fei Li, Huiping Li, Yuyao He

This paper presents two stochastic model predictive control methods for linear time-invariant systems subject to unbounded additive uncertainties. The new methods are developed by formulating the chance constraints into …

Model Predictive Control

Linear Time Complexity Deep Fourier Scattering Network and Extension to Nonlinear Invariants

2017-07-18 · Randall Balestriero, Herve Glotin

In this paper we propose a scalable version of a state-of-the-art deterministic time-invariant feature extraction approach based on consecutive changes of basis and nonlinearities, namely, the scattering network. The fir…

Convergence and Implicit Bias of Gradient Flow on Overparametrized Linear Networks

2021-05-13 · Hancheng Min, Salma Tarmoun, Rene Vidal, Enrique Mallada

Neural networks trained via gradient descent with random initialization and without any regularization enjoy good generalization performance in practice despite being highly overparametrized. A promising direction to exp…