paper-with-me

홈 › Papers

Adapting $k$-means algorithms for outliers

2020-07-02 · Christoph Grunau, Václav Rozhoň

This paper shows how to adapt several simple and classical sampling-based algorithms for the $k$-means problem to the setting with outliers. Recently, Bhaskara et al. (NeurIPS 2019) showed how to adapt the classical $k$-means++ algorithm to the setting with outliers. However, their algorithm needs to output $O(\log (k) \cdot z)$ outliers, where $z$ is the number of true outliers, to match the $O(\log k)$-approximation guarantee of $k$-means++. In this paper, we build on their ideas and show how to adapt several sequential and distributed $k$-means algorithms to the setting with outliers, but with substantially stronger theoretical guarantees: our algorithms output $(1+\varepsilon)z$ outliers while achieving an $O(1 / \varepsilon)$-approximation to the objective function. In the sequential world, we achieve this by adapting a recent algorithm of Lattanzi and Sohler (ICML 2019). In the distributed setting, we adapt a simple algorithm of Guha et al. (IEEE Trans. Know. and Data Engineering 2003) and the popular $k$-means$\|$ of Bahmani et al. (PVLDB 2012). A theoretical application of our techniques is an algorithm with running time $\tilde{O}(nk^2/z)$ that achieves an $O(1)$-approximation to the objective function while outputting $O(z)$ outliers, assuming $k \ll z \ll n$. This is complemented with a matching lower bound of $\Omega(nk^2/z)$ for this problem in the oracle model.

📄 PDF Abstract BibTeX arXiv:2007.01118

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributed $k$-Clustering for Data with Heavy Noise

2018-10-18 · NeurIPS 2018 · Xiangyu Guo, Shi Li

In this paper, we consider the $k$-center/median/means clustering with outliers problems (or the $(k, z)$-center/median/means problems) in the distributed setting. Most previous distributed algorithms have their communic…

Clustering

Distributed k-Clustering for Data with Heavy Noise

2018-12-01 · NeurIPS 2018 12 · Shi Li, Xiangyu Guo

In this paper, we consider the $k$-center/median/means clustering with outliers problems (or the $(k, z)$-center/median/means problems) in the distributed setting. Most previous distributed algorithms have their communi…

Clustering

Robust Trimmed k-means

2021-08-16 · Olga Dorabiala, J. Nathan Kutz, Aleksandr Aravkin

Clustering is a fundamental tool in unsupervised learning, used to group objects by distinguishing between similar and dissimilar features of a given data set. One of the most common clustering algorithms is k-means. Unf…

Clustering

Simple KNN-Based Outlier Detection Achieves Robust Clustering

2026-05-08 · Tianle Jiang, Yufa Zhou arxiv

Being robust to the presence of outliers is crucial for applying clustering algorithms in practice. In the $\textit{robust $k$-Means}$ problem (i.e., $k$-Means with outliers), the goal is to remove $z$ outliers and minim…

Outlier Detection

Greedy Sampling for Approximate Clustering in the Presence of Outliers

2019-12-01 · NeurIPS 2019 12 · Aditya Bhaskara, Sharvaree Vadgama, Hong Xu

Greedy algorithms such as adaptive sampling (k-means++) and furthest point traversal are popular choices for clustering problems. One the one hand, they possess good theoretical approximation guarantees, and on the other…

Clustering