A Binary Optimization Approach for Constrained K-Means Clustering
K-Means clustering still plays an important role in many computer vision problems. While the conventional Lloyd method, which alternates between centroid update and cluster assignment, is primarily used in practice, it may converge to a solution with empty clusters. Furthermore, some applications may require the clusters to satisfy a specific set of constraints, e.g., cluster sizes, must-link/cannot-link. Several methods have been introduced to solve constrained K-Means clustering. Due to the non-convex nature of K-Means, however, existing approaches may result in sub-optimal solutions that poorly approximate the true clusters. In this work, we provide a new perspective to tackle this problem. Particularly, we reconsider constrained K-Means as a Binary Optimization Problem and propose a novel optimization scheme to search for feasible solutions in the binary domain. This approach allows us to solve constrained K-Means where multiple types of constraints can be simultaneously enforced. Experimental results on synthetic and real datasets show that our method provides better clustering accuracy with faster runtime compared to several commonly used techniques.
Code (1)
Tasks
ClusteringSimilar Papers 제목 키워드 기반
Constrained Clustering: General Pairwise and Cardinality Constraints
We study constrained clustering, where constraints guide the clustering process. In existing works, two categories of constraints have been widely explored, namely pairwise and cardinality constraints. Pairwise constrain…
ClusteringConstrained ClusteringHighly-Economized Multi-View Binary Compression for Scalable Image Clustering
How to economically cluster large-scale multi-view images is a long-standing problem in computer vision. To tackle this challenge, we introduce a novel approach named Highly-economized Scalable Image Clustering (HSIC) th…
ClusteringImage ClusteringRepresentation LearningData Clustering using a Hybrid of Fuzzy C-Means and Quantum-behaved Particle Swarm Optimization
Fuzzy clustering has become a widely used data mining technique and plays an important role in grouping, traversing and selectively using data for user specified applications. The deterministic Fuzzy C-Means (FCM) algori…
ClusteringQuantizationWeb Scale Photo Hash Clustering on A Single Machine
This paper addresses the problem of clustering a very large number of photos (i.e. hundreds of millions a day) in a stream into millions of clusters. This is particularly important as the popularity of photo sharing webs…
ClusteringOnline ClusteringSpam detectionClustering Binary Data by Application of Combinatorial Optimization Heuristics
We study clustering methods for binary data, first defining aggregation criteria that measure the compactness of clusters. Five new and original methods are introduced, using neighborhoods and population behavior combina…
ClusteringCombinatorial Optimization