paper-with-me

Papers

Similarity Kernel and Clustering via Random Projection Forests

2019-08-28 · Donghui Yan, Songxiang Gu, Ying Xu, Zhiwei Qin

Similarity plays a fundamental role in many areas, including data mining, machine learning, statistics and various applied domains. Inspired by the success of ensemble methods and the flexibility of trees, we propose to learn a similarity kernel called rpf-kernel through random projection forests (rpForests). Our theoretical analysis reveals a highly desirable property of rpf-kernel: far-away (dissimilar) points have a low similarity value while nearby (similar) points would have a high similarity}, and the similarities have a native interpretation as the probability of points remaining in the same leaf nodes during the growth of rpForests. The learned rpf-kernel leads to an effective clustering algorithm--rpfCluster. On a wide variety of real and benchmark datasets, rpfCluster compares favorably to K-means clustering, spectral clustering and a state-of-the-art clustering ensemble algorithm--Cluster Forests. Our approach is simple to implement and readily adapt to the geometry of the underlying data. Given its desirable theoretical property and competitive empirical performance when applied to clustering, we expect rpf-kernel to be applicable to many problems of an unsupervised nature or as a regularizer in some supervised or weakly supervised settings.

📄 PDF Abstract BibTeX arXiv:1908.10506

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringClustering Ensemble

Methods 이 논문이 사용한 방법론

Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

Similar Papers 제목 키워드 기반

K-nearest Neighbor Search by Random Projection Forests

2018-12-31 · Donghui Yan, Yingjie Wang, Jin Wang, Honggang Wang 외

K-nearest neighbor (kNN) search has wide applications in many areas, including data mining, machine learning, statistics and many applied domains. Inspired by the success of ensemble methods and the flexibility of tree-b…

Random projection tree similarity metric for SpectralNet

2023-02-25 · Mashaan Alshammari, John Stavrakakis, Adel F. Ahmed, Masahiro Takatsuka

SpectralNet is a graph clustering method that uses neural network to find an embedding that separates the data. So far it was only used with $k$-nn graphs, which are usually constructed using a distance metric (e.g., Euc…

ClusteringGraph ClusteringGraph Embeddinggraph partitioning+1

$DC^2$: A Divide-and-conquer Algorithm for Large-scale Kernel Learning with Application to Clustering

2019-11-16 · Ke Alexander Wang, Xinran Bian, Pan Liu, Donghui Yan

Divide-and-conquer is a general strategy to deal with large scale problems. It is typically applied to generate ensemble instances, which potentially limits the problem size it can handle. Additionally, the data are ofte…

Clustering

Sign Stable Random Projections for Large-Scale Learning

2015-04-27 · Ping Li

We study the use of "sign $\alpha$-stable random projections" (where $0<\alpha\leq 2$) for building basic data processing tools in the context of large-scale machine learning applications (e.g., classification, regressio…

ARCClusteringGeneral Classification

Sparse Projection Oblique Randomer Forests

2015-06-10 · Tyler M. Tomita, James Browne, Cencheng Shen, Jaewon Chung 외

Decision forests, including Random Forests and Gradient Boosting Trees, have recently demonstrated state-of-the-art performance in a variety of machine learning settings. Decision forests are typically ensembles of axis-…

Computational Efficiency