Refining a $k$-nearest neighbor graph for a computationally efficient spectral clustering
Spectral clustering became a popular choice for data clustering for its ability of uncovering clusters of different shapes. However, it is not always preferable over other clustering methods due to its computational demands. One of the effective ways to bypass these computational demands is to perform spectral clustering on a subset of points (data representatives) then generalize the clustering outcome, this is known as approximate spectral clustering (ASC). ASC uses sampling or quantization to select data representatives. This makes it vulnerable to 1) performance inconsistency (since these methods have a random step either in initialization or training), 2) local statistics loss (because the pairwise similarities are extracted from data representatives instead of data points). We proposed a refined version of $k$-nearest neighbor graph, in which we keep data points and aggressively reduce number of edges for computational efficiency. Local statistics were exploited to keep the edges that do not violate the intra-cluster distances and nullify all other edges in the $k$-nearest neighbor graph. We also introduced an optional step to automatically select the number of clusters $C$. The proposed method was tested on synthetic and real datasets. Compared to ASC methods, the proposed method delivered a consistent performance despite significant reduction of edges.
Code (1)
Tasks
ClusteringComputational EfficiencyGraph ClusteringGraph Embeddinggraph partitioningQuantizationSpectral Graph ClusteringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Refining a -nearest neighbor graph for a computationally efficient spectral clustering
Spectral clustering became a popular choice for data clustering for its ability of uncovering clusters of different shapes. However, it is not always preferable over other clustering methods due to its computational dema…
ClusteringComputational EfficiencyGraph ClusteringGraph Embedding+3Data is missing again -- Reconstruction of power generation data using $k$-Nearest Neighbors and spectral graph theory
The risk of missing data and subsequent incomplete data records at wind farms increases with the number of turbines and sensors. We propose here an imputation method that blends data-driven concepts with expert knowledge…
ImputationPredicting Soil Properties from Hyperspectral Satellite Images
The AI4EO HYPERVIEW challenge seeks machine learning methods that predict agriculturally relevant soil parameters (K, Mg, P2O5, pH) from airborne hyperspectral images. We present a hybrid model fusing Random Forest an…
Seeing Beyond the VisibleIncorporating Fairness in Neighborhood Graphs for Fair Spectral Clustering
Graph clustering plays a pivotal role in unsupervised learning methods like spectral clustering, yet traditional methods for graph clustering often perpetuate bias through unfair graph constructions that may underreprese…
Graph ClusteringUMAP Is Spectral Clustering on the Fuzzy Nearest-Neighbor Graph
UMAP (Uniform Manifold Approximation and Projection) is among the most widely used algorithms for non linear dimensionality reduction and data visualisation. Despite its popularity, and despite being presented through th…
Dimensionality ReductionContrastive Learning