paper-with-me

Papers

Measuring and Explaining the Inter-Cluster Reliability of Multidimensional Projections

2021-07-16 · Hyeon Jeon, Hyung-Kwon Ko, Jaemin Jo, Youngtaek Kim, Jinwook Seo

We propose Steadiness and Cohesiveness, two novel metrics to measure the inter-cluster reliability of multidimensional projection (MDP), specifically how well the inter-cluster structures are preserved between the original high-dimensional space and the low-dimensional projection space. Measuring inter-cluster reliability is crucial as it directly affects how well inter-cluster tasks (e.g., identifying cluster relationships in the original space from a projected view) can be conducted; however, despite the importance of inter-cluster tasks, we found that previous metrics, such as Trustworthiness and Continuity, fail to measure inter-cluster reliability. Our metrics consider two aspects of the inter-cluster reliability: Steadiness measures the extent to which clusters in the projected space form clusters in the original space, and Cohesiveness measures the opposite. They extract random clusters with arbitrary shapes and positions in one space and evaluate how much the clusters are stretched or dispersed in the other space. Furthermore, our metrics can quantify pointwise distortions, allowing for the visualization of inter-cluster reliability in a projection, which we call a reliability map. Through quantitative experiments, we verify that our metrics precisely capture the distortions that harm inter-cluster reliability while previous metrics have difficulty capturing the distortions. A case study also demonstrates that our metrics and the reliability map 1) support users in selecting the proper projection techniques or hyperparameters and 2) prevent misinterpretation while performing inter-cluster tasks, thus allow an adequate identification of inter-cluster structure.

📄 PDF Abstract BibTeX arXiv:2107.07859

Code (3)

hj-n/snc-reliability-map 공식 구현
hj-n/steadiness-cohesiveness 공식 구현
hj-n/zadu

Similar Papers 제목 키워드 기반

Towards Spectroscopy: Susceptibility Clusters in Language Models

2026-01-19 · Andrew Gordon, Garrett Baker, George Wang, William Snell 외 arxiv

Spectroscopy infers the internal structure of physical systems by measuring their response to perturbations. We apply this principle to neural networks: perturbing the data distribution by upweighting a token $y$ in cont…

A complex net of intertwined complements: Measuring interdimensional dependence among the poor

2019-08-21

The choice of appropriate measures of deprivation, identification and aggregation of poverty has been a challenge for many years. The works of Sen, Atkinson and others have been the cornerstone for most of the literature…

Unique Metric for Health Analysis with Optimization of Clustering Activity and Cross Comparison of Results from Different Approach

2018-10-08 · Kumarjit Pathak, Jitin Kapila

In machine learning and data mining, Cluster analysis is one of the most widely used unsupervised learning technique. Philosophy of this algorithm is to find similar data items and group them together based on any distan…

ClusteringDescriptivePhilosophy

Modified Multidimensional Scaling and High Dimensional Clustering

2018-10-24 · Xiucai Ding, Qiang Sun

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. B…

ClusteringDimensionality ReductionVocal Bursts Intensity Prediction

Distortion-Aware Brushing for Reliable Cluster Analysis in Multidimensional Projections

2022-01-17 · Hyeon Jeon, Michaël Aupetit, Soohyun Lee, Kwon Ko 외

Brushing is a common interaction technique in 2D scatterplots, allowing users to select clustered points within a continuous, enclosed region for further analysis or filtering. However, applying conventional brushing to …