paper-with-me

홈 › Papers

Distributed Graph Clustering by Load Balancing

2016-07-18 · He Sun, Luca Zanetti

Graph clustering is a fundamental computational problem with a number of applications in algorithm design, machine learning, data mining, and analysis of social networks. Over the past decades, researchers have proposed a number of algorithmic design methods for graph clustering. However, most of these methods are based on complicated spectral techniques or convex optimisation, and cannot be applied directly for clustering many networks that occur in practice, whose information is often collected on different sites. Designing a simple and distributed clustering algorithm is of great interest, and has wide applications for processing big datasets. In this paper we present a simple and distributed algorithm for graph clustering: for a wide class of graphs that are characterised by a strong cluster-structure, our algorithm finishes in a poly-logarithmic number of rounds, and recovers a partition of the graph close to an optimal partition. The main component of our algorithm is an application of the random matching model of load balancing, which is a fundamental protocol in distributed computing and has been extensively studied in the past 20 years. Hence, our result highlights an intrinsic and interesting connection between graph clustering and load balancing. At a technical level, we present a purely algebraic result characterising the early behaviours of load balancing processes for graphs exhibiting a cluster-structure. We believe that this result can be further applied to analyse other gossip processes, such as rumour spreading and averaging processes.

📄 PDF Abstract BibTeX arXiv:1607.04984

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDistributed ComputingGraph Clustering

Similar Papers 제목 키워드 기반

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game

2022-06-03 · Zhiyuan Yao, Zihan Ding

This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this pro…

FairnessManagementMulti-agent Reinforcement Learning

Dynamic Power Balancing Algorithm for Single-Phase Energy Storage Systems in LV Distribution Network with Unbalanced PV Systems Distribution

2020-11-12 · Watcharakorn Pinthurat, Branislav Hredzak

Unbalanced power, due to high penetration of single-phase PV rooftops into a four-wire multi-grounded LV distribution system, can result in significant rise in the neutral current and neutral voltage. This preprint propo…

Clustering

One-Shot Federated Clustering of Non-Independent Completely Distributed Data

2026-01-24 · Yiqun Zhang, Shenghong Cai, Zihua Yang, Sen Feng 외 arxiv

Federated Learning (FL) that extracts data knowledge while protecting the privacy of multiple clients has achieved remarkable results in distributed privacy-preserving IoT systems, including smart traffic flow monitoring…

Federated Learning

Distributed Inexact Damped Newton Method: Data Partitioning and Load-Balancing

2016-03-16 · Chenxin Ma, Martin Takáč

In this paper we study inexact dumped Newton method implemented in a distributed environment. We start with an original DiSCO algorithm [Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss,…

Distributed Optimization

Addressing Algorithmic Bottlenecks in Elastic Machine Learning with Chicle

2019-09-11 · Michael Kaufmann, Kornilios Kourtis, Celestine Mendler-Dünner, Adrian Schüpbach 외

Distributed machine learning training is one of the most common and important workloads running on data centers today, but it is rarely executed alone. Instead, to reduce costs, computing resources are consolidated and s…

BIG-bench Machine LearningFairness