paper-with-me

홈 › Papers

Bagged $k$-Distance for Mode-Based Clustering Using the Probability of Localized Level Sets

2022-10-18 · Hanyuan Hang

In this paper, we propose an ensemble learning algorithm named \textit{bagged $k$-distance for mode-based clustering} (\textit{BDMBC}) by putting forward a new measurement called the \textit{probability of localized level sets} (\textit{PLLS}), which enables us to find all clusters for varying densities with a global threshold. On the theoretical side, we show that with a properly chosen number of nearest neighbors $k_D$ in the bagged $k$-distance, the sub-sample size $s$, the bagging rounds $B$, and the number of nearest neighbors $k_L$ for the localized level sets, BDMBC can achieve optimal convergence rates for mode estimation. It turns out that with a relatively small $B$, the sub-sample size $s$ can be much smaller than the number of training data $n$ at each bagging round, and the number of nearest neighbors $k_D$ can be reduced simultaneously. Moreover, we establish optimal convergence results for the level set estimation of the PLLS in terms of Hausdorff distance, which reveals that BDMBC can find localized level sets for varying densities and thus enjoys local adaptivity. On the practical side, we conduct numerical experiments to empirically verify the effectiveness of BDMBC for mode estimation and level set estimation, which demonstrates the promising accuracy and efficiency of our proposed algorithm.

📄 PDF Abstract BibTeX arXiv:2210.09786

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble Learning

Similar Papers 제목 키워드 기반

Review and Perspective for Distance Based Trajectory Clustering

2015-08-20 · Philippe Besse, Brendan Guillouet, Jean-Michel Loubes, Royer François

In this paper we tackle the issue of clustering trajectories of geolocalized observations. Using clustering technics based on the choice of a distance between the observations, we first provide a comprehensive review of …

ClusteringTrajectory Clustering

The Shape of Data and Probability Measures

2015-09-15 · Diego Hernán Díaz Martínez, Facundo Mémoli, Washington Mio

We introduce the notion of multiscale covariance tensor fields (CTF) associated with Euclidean random variables as a gateway to the shape of their distributions. Multiscale CTFs quantify variation of the data about every…

Clustering

Bagged Regularized $k$-Distances for Anomaly Detection

2023-12-02 · Yuchao Cai, Yuheng Ma, Hanfang Yang, Hanyuan Hang

We consider the paradigm of unsupervised anomaly detection, which involves the identification of anomalies within a dataset in the absence of labeled examples. Though distance-based methods are top-performing for unsuper…

Anomaly DetectionDensity EstimationSensitivityUnsupervised Anomaly Detection

Diffusion $K$-means clustering on manifolds: provable exact recovery via semidefinite relaxations

2019-03-11 · Xiaohui Chen, Yun Yang

We introduce the {\it diffusion $K$-means} clustering method on Riemannian submanifolds, which maximizes the within-cluster connectedness based on the diffusion distance. The diffusion $K$-means constructs a random walk …

Clustering

Bagged Boosted Trees for Classification of Ecological Momentary Assessment Data

2016-07-06 · Gerasimos Spanakis, Gerhard Weiss, Anne Roefs

Ecological Momentary Assessment (EMA) data is organized in multiple levels (per-subject, per-day, etc.) and this particular structure should be taken into account in machine learning algorithms used in EMA like decision …

BIG-bench Machine LearningGeneral Classification