Can an unsupervised clustering algorithm reproduce a categorization system?
Peer analysis is a critical component of investment management, often relying on expert-provided categorization systems. These systems' consistency is questioned when they do not align with cohorts from unsupervised clustering algorithms optimized for various metrics. We investigate whether unsupervised clustering can reproduce ground truth classes in a labeled dataset, showing that success depends on feature selection and the chosen distance metric. Using toy datasets and fund categorization as real-world examples we demonstrate that accurately reproducing ground truth classes is challenging. We also highlight the limitations of standard clustering evaluation metrics in identifying the optimal number of clusters relative to the ground truth classes. We then show that if appropriate features are available in the dataset, and a proper distance metric is known (e.g., using a supervised Random Forest-based distance metric learning method), then an unsupervised clustering can indeed reproduce the ground truth classes as distinct clusters.
Code (0)
등록된 구현이 없습니다.
Tasks
Clusteringfeature selectionManagementMetric LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Unsupervised Random Forest Clustering Technique for Automatic Traffic Scenario Categorization
A modification of the Random Forest algorithm for the categorization of traffic situations is introduced in this paper. The procedure yields an unsupervised machine learning method. The algorithm generates a proximity ma…
ClusteringConvolutional Clustering for Unsupervised Learning
The task of labeling data for training deep neural networks is daunting and tedious, requiring millions of labels to achieve the current state-of-the-art results. Such reliance on large amounts of labeled data can be rel…
ClusteringImage ClassificationNo Pattern, No Recognition: a Survey about Reproducibility and Distortion Issues of Text Clustering and Topic Modeling
Extracting knowledge from unlabeled texts using machine learning algorithms can be complex. Document categorization and information retrieval are two applications that may benefit from unsupervised learning (e.g., text c…
BIG-bench Machine LearningClusteringInformation RetrievalRetrieval+2Unsupervised Clustering for Fault Analysis in High-Voltage Power Systems Using Voltage and Current Signals
The widespread use of sensors in modern power grids has led to the accumulation of large amounts of voltage and current waveform data, especially during fault events. However, the lack of labeled datasets poses a signifi…
Fault DiagnosisRTETime Series ClusteringAnalysis of Sparse Subspace Clustering: Experiments and Random Projection
Clustering can be defined as the process of assembling objects into a number of groups whose elements are similar to each other in some manner. As a technique that is used in many domains, such as face clustering, plant …
ClusteringDocument ClassificationFace ClusteringImage Segmentation+1