Distributed Graph Clustering by Load Balancing
Graph clustering is a fundamental computational problem with a number of applications in algorithm design, machine learning, data mining, and analysis of social networks. Over the past decades, researchers have proposed a number of algorithmic design methods for graph clustering. However, most of these methods are based on complicated spectral techniques or convex optimisation, and cannot be applied directly for clustering many networks that occur in practice, whose information is often collected on different sites. Designing a simple and distributed clustering algorithm is of great interest, and has wide applications for processing big datasets. In this paper we present a simple and distributed algorithm for graph clustering: for a wide class of graphs that are characterised by a strong cluster-structure, our algorithm finishes in a poly-logarithmic number of rounds, and recovers a partition of the graph close to an optimal partition. The main component of our algorithm is an application of the random matching model of load balancing, which is a fundamental protocol in distributed computing and has been extensively studied in the past 20 years. Hence, our result highlights an intrinsic and interesting connection between graph clustering and load balancing. At a technical level, we present a purely algebraic result characterising the early behaviours of load balancing processes for graphs exhibiting a cluster-structure. We believe that this result can be further applied to analyse other gossip processes, such as rumour spreading and averaging processes.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDistributed ComputingGraph ClusteringSimilar Papers 제목 키워드 기반
Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game
This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this pro…
FairnessManagementMulti-agent Reinforcement LearningDynamic Power Balancing Algorithm for Single-Phase Energy Storage Systems in LV Distribution Network with Unbalanced PV Systems Distribution
Unbalanced power, due to high penetration of single-phase PV rooftops into a four-wire multi-grounded LV distribution system, can result in significant rise in the neutral current and neutral voltage. This preprint propo…
ClusteringOne-Shot Federated Clustering of Non-Independent Completely Distributed Data
Federated Learning (FL) that extracts data knowledge while protecting the privacy of multiple clients has achieved remarkable results in distributed privacy-preserving IoT systems, including smart traffic flow monitoring…
Federated LearningDistributed Inexact Damped Newton Method: Data Partitioning and Load-Balancing
In this paper we study inexact dumped Newton method implemented in a distributed environment. We start with an original DiSCO algorithm [Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss,…
Distributed OptimizationAddressing Algorithmic Bottlenecks in Elastic Machine Learning with Chicle
Distributed machine learning training is one of the most common and important workloads running on data centers today, but it is rarely executed alone. Instead, to reduce costs, computing resources are consolidated and s…
BIG-bench Machine LearningFairness