paper-with-me

홈 › Papers

MC-GTA: Metric-Constrained Model-Based Clustering using Goodness-of-fit Tests with Autocorrelations

2024-05-28 · Zhangyu Wang, Gengchen Mai, Krzysztof Janowicz, Ni Lao

A wide range of (multivariate) temporal (1D) and spatial (2D) data analysis tasks, such as grouping vehicle sensor trajectories, can be formulated as clustering with given metric constraints. Existing metric-constrained clustering algorithms overlook the rich correlation between feature similarity and metric distance, i.e., metric autocorrelation. The model-based variations of these clustering algorithms (e.g. TICC and STICC) achieve SOTA performance, yet suffer from computational instability and complexity by using a metric-constrained Expectation-Maximization procedure. In order to address these two problems, we propose a novel clustering algorithm, MC-GTA (Model-based Clustering via Goodness-of-fit Tests with Autocorrelations). Its objective is only composed of pairwise weighted sums of feature similarity terms (square Wasserstein-2 distance) and metric autocorrelation terms (a novel multivariate generalization of classic semivariogram). We show that MC-GTA is effectively minimizing the total hinge loss for intra-cluster observation pairs not passing goodness-of-fit tests, i.e., statistically not originating from the same distribution. Experiments on 1D/2D synthetic and real-world datasets demonstrate that MC-GTA successfully incorporates metric autocorrelation. It outperforms strong baselines by large margins (up to 14.3% in ARI and 32.1% in NMI) with faster and stabler optimization (>10x speedup).

📄 PDF Abstract BibTeX arXiv:2405.18395

Code (1)

Octopolugal/MC-GTA 공식 구현

Tasks

ClusteringConstrained Clustering

Similar Papers 제목 키워드 기반

Goodness-of-Fit and Clustering of Spherical Data: the QuadratiK package in R and Python

2024-02-03 · Giovanni Saraceno, Marianthi Markatou, Raktim Mukhopadhyay, Mojgan Golzy

We introduce the QuadratiK package that incorporates innovative data analysis methodologies. The presented software, implemented in both R and Python, offers a comprehensive set of goodness-of-fit tests and clustering te…

Clustering

Hardware-in-the-Loop Evaluation of Goodness of Fit (GoF) Testing for Dynamic Spectrum Sharing

2025-01-22 · Mir Lodro, Simon Armour, Mark A. Beach

In contrast to parametric spectrum sensing, non-parametric spectrum sensing can effectively detect the primary user's presence or absence without prior information about the primary user. Particularly, non-parametric spe…

Goodness-of-Fit Tests for Inhomogeneous Random Graphs

2020-01-01 · ICML 2020 1 · Soham Dan, Bhaswar B. Bhattacharya

Hypothesis testing of random networks is an emerging area of modern research, especially in the high-dimensional regime, where the number of samples is smaller or comparable to the size of the graph. In this paper we c…

Two-sample testing

Goodness-of-fit Testing for Discrete Distributions via Stein Discrepancy

2018-07-01 · ICML 2018 7 · Jiasen Yang, Qiang Liu, Vinayak Rao, Jennifer Neville

Recent work has combined Stein’s method with reproducing kernel Hilbert space theory to develop nonparametric goodness-of-fit tests for un-normalized probability distributions. However, the currently available tests…

Standardisation-function Kernel Stein Discrepancy: A Unifying View on Kernel Stein Discrepancy Tests for Goodness-of-fit

2021-06-23 · Wenkai Xu

Non-parametric goodness-of-fit testing procedures based on kernel Stein discrepancies (KSD) are promising approaches to validate general unnormalised distributions in various scenarios. Existing works focused on studying…