paper-with-me

홈 › Papers

Two provably consistent divide and conquer clustering algorithms for large networks

2017-08-18 · Soumendu Sundar Mukherjee, Purnamrita Sarkar, Peter J. Bickel

In this article, we advance divide-and-conquer strategies for solving the community detection problem in networks. We propose two algorithms which perform clustering on a number of small subgraphs and finally patches the results into a single clustering. The main advantage of these algorithms is that they bring down significantly the computational cost of traditional algorithms, including spectral clustering, semi-definite programs, modularity based methods, likelihood based methods etc., without losing on accuracy and even improving accuracy at times. These algorithms are also, by nature, parallelizable. Thus, exploiting the facts that most traditional algorithms are accurate and the corresponding optimization problems are much simpler in small problems, our divide-and-conquer methods provide an omnibus recipe for scaling traditional algorithms up to large networks. We prove consistency of these algorithms under various subgraph selection procedures and perform extensive simulations and real-data analysis to understand the advantages of the divide-and-conquer approach in various settings.

📄 PDF Abstract BibTeX arXiv:1708.05573

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringCommunity DetectionVocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

$DC^2$: A Divide-and-conquer Algorithm for Large-scale Kernel Learning with Application to Clustering

2019-11-16 · Ke Alexander Wang, Xinran Bian, Pan Liu, Donghui Yan

Divide-and-conquer is a general strategy to deal with large scale problems. It is typically applied to generate ensemble instances, which potentially limits the problem size it can handle. Additionally, the data are ofte…

Clustering

Divide-and-conquer based Large-Scale Spectral Clustering

2021-04-30 · Hongmin Li, Xiucai Ye, Akira Imakura, Tetsuya Sakurai

Spectral clustering is one of the most popular clustering methods. However, how to balance the efficiency and effectiveness of the large-scale spectral clustering with limited computing resources has not been properly so…

ClusteringImage/Document Clustering

Homogenous and Heterogenous Parallel Clustering: An Overview

2022-02-14 · Ahmed Ibrahim, Rokaya Hassanien

Recent advances in computer architecture and networking opened the opportunity for parallelizing the clustering algorithms. This divide-and-conquer strategy often results in better results to centralized clustering with …

Clustering

Divide and Conquer: 3D Point Cloud Instance Segmentation With Point-Wise Binarization

2022-07-22 · ICCV 2023 1 · Weiguang Zhao, Yuyao Yan, Chaolong Yang, Jianan Ye 외

Instance segmentation on point clouds is crucially important for 3D scene understanding. Most SOTAs adopt distance clustering, which is typically effective but does not perform well in segmenting adjacent objects with th…

3D Instance Segmentation3D Object DetectionBinarizationClustering+2

Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithm

2024-08-11 · Eli Sennesh, Hao Wu, Tommaso Salvatori

Unexpected stimuli induce "error" or "surprise" signals in the brain. The theory of predictive coding promises to explain these observations in terms of Bayesian inference by suggesting that the cortex implements variati…

Bayesian InferenceVariational Inference