paper-with-me

Papers

On hyperparameter tuning in general clustering problemsm

2020-01-01 · ICML 2020 1 · Xinjie Fan, Yuguang Yue, Purnamrita Sarkar, Y. X. Rachel Wang

Tuning hyperparameters for unsupervised learning problems is difficult in general due to the lack of ground truth for validation. However, the success of most clustering methods depends heavily on the correct choice of the involved hyperparameters. Take for example the Lagrange multipliers of penalty terms in semidefinite programming (SDP) relaxations of community detection in networks, or the bandwidth parameter needed in the Gaussian kernel used to construct similarity matrices for spectral clustering. Despite the popularity of these clustering algorithms, there are not many provable methods for tuning these hyperparameters. In this paper, we provide a overarching framework with provable guarantees for tuning hyperparameters in the above class of problems under two different models. Our framework can be augmented with a cross validation procedure to do model selection as well. In a variety of simulation and real data experiments, we show that our framework outperforms other widely used tuning procedures in a broad range of parameter settings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringCommunity DetectionModel Selection

Similar Papers 제목 키워드 기반

A Unified Framework for Tuning Hyperparameters in Clustering Problems

2019-10-17 · Xinjie Fan, Yuguang Yue, Purnamrita Sarkar, Y. X. Rachel Wang

Selecting hyperparameters for unsupervised learning problems is challenging in general due to the lack of ground truth for validation. Despite the prevalence of this issue in statistics and machine learning, especially i…

ClusteringCommunity DetectionModel Selection

Applying Semi-Automated Hyperparameter Tuning for Clustering Algorithms

2021-08-25 · Elizabeth Ditton, Anne Swinbourne, Trina Myers, Mitchell Scovell

When approaching a clustering problem, choosing the right clustering algorithm and parameters is essential, as each clustering algorithm is proficient at finding clusters of a particular nature. Due to the unsupervised n…

Clustering

Affinity Graph Connectivity in Convex Clustering

2026-05-23 · Sam Rosen, Jason Xu arxiv

We generalize finite-sample bounds for convex clustering to the setting where affinity weights appearing in the objective correspond to a general connected graph. These bounds and their analysis lead to a better understa…

Interpretable label-free self-guided subspace clustering

2024-11-26 · Ivica Kopriva

Majority subspace clustering (SC) algorithms depend on one or more hyperparameters that need to be carefully tuned for the SC algorithms to achieve high clustering performance. Hyperparameter optimization (HPO) is often …

ClusteringHyperparameter Optimization

Automatic Clustering for Unsupervised Risk Diagnosis of Vehicle Driving for Smart Road

2020-11-24 · Xiupeng Shi, Yiik Diew Wong, Chen Chai, Michael Zhi-Feng Li 외

Early risk diagnosis and driving anomaly detection from vehicle stream are of great benefits in a range of advanced solutions towards Smart Road and crash prevention, although there are intrinsic challenges, especially l…

Anomaly DetectionBayesian OptimisationClustering