paper-with-me

홈 › Papers

Scalable and Robust Community Detection with Randomized Sketching

2018-05-25 · Mostafa Rahmani, Andre Beckus, Adel Karimian, George Atia

This article explores and analyzes the unsupervised clustering of large partially observed graphs. We propose a scalable and provable randomized framework for clustering graphs generated from the stochastic block model. The clustering is first applied to a sub-matrix of the graph's adjacency matrix associated with a reduced graph sketch constructed using random sampling. Then, the clusters of the full graph are inferred based on the clusters extracted from the sketch using a correlation-based retrieval step. Uniform random node sampling is shown to improve the computational complexity over clustering of the full graph when the cluster sizes are balanced. A new random degree-based node sampling algorithm is presented which significantly improves upon the performance of the clustering algorithm even when clusters are unbalanced. This framework improves the phase transitions for matrix-decomposition-based clustering with regard to computational complexity and minimum cluster size, which are shown to be nearly dimension-free in the low inter-cluster connectivity regime. A third sampling technique is shown to improve balance by randomly sampling nodes based on spatial distribution. We provide analysis and numerical results using a convex clustering algorithm based on matrix completion.

📄 PDF Abstract BibTeX arXiv:1805.10927

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringCommunity DetectionMatrix CompletionRetrievalStochastic Block Model

Similar Papers 제목 키워드 기반

Randomized Spectral Clustering in Large-Scale Stochastic Block Models

2020-01-20 · Hai Zhang, Xiao Guo, Xiangyu Chang

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we stu…

ClusteringCommunity DetectionStochastic Block Model

OverSketched Newton: Fast Convex Optimization for Serverless Systems

2019-03-21 · Vipul Gupta, Swanand Kadhe, Thomas Courtade, Michael W. Mahoney 외

Motivated by recent developments in serverless systems for large-scale computation as well as improvements in scalable randomized matrix algorithms, we develop OverSketched Newton, a randomized Hessian-based optimization…

Distributed Optimization

Community Detection with a Subsampled Semidefinite Program

2021-02-02 · Pedro Abdalla, Afonso S. Bandeira

Semidefinite programming is an important tool to tackle several problems in data science and signal processing, including clustering and community detection. However, semidefinite programs are often slow in practice, so …

ClusteringCommunity DetectionStochastic Block Model

Large-scale subspace clustering using sketching and validation

2015-10-06 · Panagiotis A. Traganitis, Konstantinos Slavakis, Georgios B. Giannakis

The nowadays massive amounts of generated and communicated data present major challenges in their processing. While capable of successfully classifying nonlinearly separable objects in various settings, subspace clusteri…

Clustering

Sketching Structured Matrices for Faster Nonlinear Regression

2013-12-01 · NeurIPS 2013 12 · Haim Avron, Vikas Sindhwani, David Woodruff

Motivated by the desire to extend fast randomized techniques to nonlinear $l_p$ regression, we consider a class of structured regression problems. These problems involve Vandermonde matrices which arise naturally in vari…

regression