paper-with-me

홈 › Papers

Scaling up Dynamic Edge Partition Models via Stochastic Gradient MCMC

2024-02-29 · Sikun Yang, Heinz Koeppl

The edge partition model (EPM) is a generative model for extracting an overlapping community structure from static graph-structured data. In the EPM, the gamma process (GaP) prior is adopted to infer the appropriate number of latent communities, and each vertex is endowed with a gamma distributed positive memberships vector. Despite having many attractive properties, inference in the EPM is typically performed using Markov chain Monte Carlo (MCMC) methods that prevent it from being applied to massive network data. In this paper, we generalize the EPM to account for dynamic enviroment by representing each vertex with a positive memberships vector constructed using Dirichlet prior specification, and capturing the time-evolving behaviour of vertices via a Dirichlet Markov chain construction. A simple-to-implement Gibbs sampler is proposed to perform posterior computation using Negative- Binomial augmentation technique. For large network data, we propose a stochastic gradient Markov chain Monte Carlo (SG-MCMC) algorithm for scalable inference in the proposed model. The experimental results show that the novel methods achieve competitive performance in terms of link prediction, while being much faster.

📄 PDF Abstract BibTeX arXiv:2403.00044

Code (0)

등록된 구현이 없습니다.

Tasks

Link Prediction

Similar Papers 제목 키워드 기반

SGB: Stochastic Gradient Bound Method for Optimizing Partition Functions

2020-11-03 · Jing Wang, Anna Choromanska

This paper addresses the problem of optimizing partition functions in a stochastic learning setting. We propose a stochastic variant of the bound majorization algorithm that relies on upper-bounding the partition functio…

Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent

2023-02-14 · Benjamin Gess, Sebastian Kassing, Vitalii Konarovskyi

We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and improve the so-called stocha…

Partitioned integrators for thermodynamic parameterization of neural networks

2019-08-30 · Benedict Leimkuhler, Charles Matthews, Tiffany Vlaar

Traditionally, neural networks are parameterized using optimization procedures such as stochastic gradient descent, RMSProp and ADAM. These procedures tend to drive the parameters of the network toward a local minimum. I…

High-dimensional learning dynamics of multi-pass Stochastic Gradient Descent in multi-index models

2026-01-28 · Zhou Fan, Leda Wang arxiv

We study the learning dynamics of a multi-pass, mini-batch Stochastic Gradient Descent (SGD) procedure for empirical risk minimization in high-dimensional multi-index models with isotropic random data. In an asymptotic r…

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks

2025-11-04 · Parsa Rangriz arxiv

This paper studies the high-dimensional scaling limits of online stochastic gradient descent (SGD). Building on the work of Ben Arous, Gheissari, and Jagannath on the effective dynamics of SGD, we study the critical scal…