paper-with-me

홈 › Papers

Nonparametric Bayesian inference of the microcanonical stochastic block model

2016-10-09 · Tiago P. Peixoto

A principled approach to characterize the hidden structure of networks is to formulate generative models, and then infer their parameters from data. When the desired structure is composed of modules or "communities", a suitable choice for this task is the stochastic block model (SBM), where nodes are divided into groups, and the placement of edges is conditioned on the group memberships. Here, we present a nonparametric Bayesian method to infer the modular structure of empirical networks, including the number of modules and their hierarchical organization. We focus on a microcanonical variant of the SBM, where the structure is imposed via hard constraints, i.e. the generated networks are not allowed to violate the patterns imposed by the model. We show how this simple model variation allows simultaneously for two important improvements over more traditional inference approaches: 1. Deeper Bayesian hierarchies, with noninformative priors replaced by sequences of priors and hyperpriors, that not only remove limitations that seriously degrade the inference on large networks, but also reveal structures at multiple scales; 2. A very efficient inference algorithm that scales well not only for networks with a large number of nodes and edges, but also with an unlimited number of modules. We show also how this approach can be used to sample modular hierarchies from the posterior distribution, as well as to perform model selection. We discuss and analyze the differences between sampling from the posterior and simply finding the single parameter estimate that maximizes it. Furthermore, we expose a direct equivalence between our microcanonical approach and alternative derivations based on the canonical SBM.

📄 PDF Abstract BibTeX arXiv:1610.02703

Code (1)

https://git.skewed.de/count0/graph-tool 공식 구현

Tasks

Bayesian InferenceModel SelectionStochastic Block Model

Similar Papers 제목 키워드 기반

Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?

2026-02-06 · Emanuel Sommer, Kangning Diao, Jakob Robnik, Uros Seljak 외 arxiv

Scaling inference methods such as Markov chain Monte Carlo to high-dimensional models remains a central challenge in Bayesian deep learning. A promising recent proposal, microcanonical Langevin Monte Carlo, has shown sta…

Bayesian Inference

Small-Variance Asymptotics for Nonparametric Bayesian Overlapping Stochastic Blockmodels

2018-07-10 · Gundeep Arora, Anupreet Porwal, Kanupriya Agarwal, Avani Samdariya 외

The latent feature relational model (LFRM) is a generative model for graph-structured data to learn a binary vector representation for each node in the graph. The binary vector denotes the node's membership in one or mor…

Combining Random Walks and Nonparametric Bayesian Topic Model for Community Detection

2016-07-19 · Ruimin Zhu, Wenxin Jiang

Community detection has been an active research area for decades. Among all probabilistic models, Stochastic Block Model has been the most popular one. This paper introduces a novel probabilistic model: RW-HDP, based on …

Community DetectionStochastic Block ModelVariational Inference

Bayesian stochastic blockmodeling

2017-05-29 · Tiago P. Peixoto

This chapter provides a self-contained introduction to the use of Bayesian inference to extract large-scale modular structures from network data, based on the stochastic blockmodel (SBM), as well as its degree-corrected …

Bayesian InferenceModel Selection

Variational inference for neural network matrix factorization and its application to stochastic blockmodeling

2019-05-11 · Onno Kampman, Creighton Heaukulani

We consider the probabilistic analogue to neural network matrix factorization (Dziugaite & Roy, 2015), which we construct with Bayesian neural networks and fit with variational inference. We find that a linear model fit …

Variational Inference