Evaluating Community Detection Algorithms for Progressively Evolving Graphs
Many algorithms have been proposed in the last ten years for the discovery of dynamic communities. However, these methods are seldom compared between themselves. In this article, we propose a generator of dynamic graphs with planted evolving community structure, as a benchmark to compare and evaluate such algorithms. Unlike previously proposed benchmarks, it is able to specify any desired evolving community structure through a descriptive language, and then to generate the corresponding progressively evolving network. We empirically evaluate six existing algorithms for dynamic community detection in terms of instantaneous and longitudinal similarity with the planted ground truth, smoothness of dynamic partitions, and scalability. We notably observe different types of weaknesses depending on their approach to ensure smoothness, namely Glitches, Oversimplification and Identity loss. Although no method arises as a clear winner, we observe clear differences between methods, and we identified the fastest, those yielding the most smoothed or the most accurate solutions at each step.
Code (0)
등록된 구현이 없습니다.
Tasks
Community DetectionDescriptiveDynamic Community DetectionSimilar Papers 제목 키워드 기반
DynBenchmark: Customizable Ground Truths to Benchmark Community Detection and Tracking in Temporal Networks
Graph models help understand network dynamics and evolution. Creating graphs with controlled topology and embedded partitions is a common strategy for evaluating community detection algorithms. However, existing benchmar…
Community DetectionBenchmarking Evolutionary Community Detection Algorithms in Dynamic Networks
In dynamic complex networks, entities interact and form network communities that evolve over time. Among the many static Community Detection (CD) solutions, the modularity-based Louvain, or Greedy Modularity Algorithm (G…
BenchmarkingCommunity DetectionA Spectral Framework for Tracking Communities in Evolving Networks
Discovering and tracking communities in time-varying networks is an important task in network science, motivated by applications in fields ranging from neuroscience to sociology. In this work, we characterize the celebra…
Community DetectionDynamic Community DetectionRiemannian optimizationSociologyEvaluating Overfit and Underfit in Models of Network Community Structure
A common data mining task on networks is community detection, which seeks an unsupervised decomposition of a network into structural groups based on statistical regularities in the network's connectivity. Although many m…
Community DetectionDiagnosticLink PredictionStochastic Block ModelEvaluating accuracy of community detection using the relative normalized mutual information
The Normalized Mutual Information (NMI) has been widely used to evaluate the accuracy of community detection algorithms. However in this article we show that the NMI is seriously affected by systematic errors due to fini…
Community Detection