paper-with-me

홈 › Papers

Fast Exact k-Means, k-Medians and Bregman Divergence Clustering in 1D

2017-01-25 · Allan Grønlund, Kasper Green Larsen, Alexander Mathiasen, Jesper Sindahl Nielsen, Stefan Schneider, Mingzhou Song

The $k$-Means clustering problem on $n$ points is NP-Hard for any dimension $d\ge 2$, however, for the 1D case there exists exact polynomial time algorithms. Previous literature reported an $O(kn^2)$ time dynamic programming algorithm that uses $O(kn)$ space. It turns out that the problem has been considered under a different name more than twenty years ago. We present all the existing work that had been overlooked and compare the various solutions theoretically. Moreover, we show how to reduce the space usage for some of them, as well as generalize them to data structures that can quickly report an optimal $k$-Means clustering for any $k$. Finally we also generalize all the algorithms to work for the absolute distance and to work for any Bregman Divergence. We complement our theoretical contributions by experiments that compare the practical performance of the various algorithms.

📄 PDF Abstract BibTeX arXiv:1701.07204

Code (2)

apple/ml-stable-diffusion pytorch
dstein64/kmeans1d

Tasks

Clustering

Similar Papers 제목 키워드 기반

Towards a median signal detector through the total Bregman divergence and its robustness analysis

2022-05-09 · Yusuke Ono, Linyu Peng

A novel family of geometric signal detectors are proposed through medians of the total Bregman divergence (TBD), which are shown advantageous over the conventional methods and their mean counterparts. By interpreting the…

Generalizing Jensen and Bregman divergences with comparative convexity and the statistical Bhattacharyya distances with comparable means

2017-02-16 · Frank Nielsen, Richard Nock

Comparative convexity is a generalization of convexity relying on abstract notions of means. We define the Jensen divergence and the Jensen diversity from the viewpoint of comparative convexity, and show how to obtain th…

Diversity

Bregman Alternating Direction Method of Multipliers

2013-06-13 · NeurIPS 2014 12 · Huahua Wang, Arindam Banerjee

The mirror descent algorithm (MDA) generalizes gradient descent by using a Bregman divergence to replace squared Euclidean distance. In this paper, we similarly generalize the alternating direction method of multipliers …

GPU

Optimal interval clustering: Application to Bregman clustering and statistical mixture learning

2014-03-11 · Frank Nielsen, Richard Nock

We present a generic dynamic programming method to compute the optimal clustering of $n$ scalar elements into $k$ pairwise disjoint intervals. This case includes 1D Euclidean $k$-means, $k$-medoids, $k$-medians, $k$-cent…

ClusteringModel Selection

Clustering with Bregman Divergences: an Asymptotic Analysis

2016-12-01 · NeurIPS 2016 12 · Chaoyue Liu, Mikhail Belkin

Clustering, in particular $k$-means clustering, is a central topic in data analysis. Clustering with Bregman divergences is a recently proposed generalization of $k$-means clustering which has already been widely used in…

ClusteringQuantization