Modeling Graph Node Correlations with Neighbor Mixture Models
We propose a new model, the Neighbor Mixture Model (NMM), for modeling node labels in a graph. This model aims to capture correlations between the labels of nodes in a local neighborhood. We carefully design the model so it could be an alternative to a Markov Random Field but with more affordable computations. In particular, drawing samples and evaluating marginal probabilities of single labels can be done in linear time. To scale computations to large graphs, we devise a variational approximation without introducing extra parameters. We further use graph neural networks (GNNs) to parameterize the NMM, which reduces the number of learnable parameters while allowing expressive representation learning. The proposed model can be either fit directly to large observed graphs or used to enable scalable inference that preserves correlations for other distributions such as deep generative graph models. Across a diverse set of node classification, image denoising, and link prediction tasks, we show our proposed NMM advances the state-of-the-art in modeling real-world labeled graphs.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingLink PredictionNode ClassificationRepresentation LearningSimilar Papers 제목 키워드 기반
HHGT: Hierarchical Heterogeneous Graph Transformer for Heterogeneous Graph Representation Learning
Despite the success of Heterogeneous Graph Neural Networks (HGNNs) in modeling real-world Heterogeneous Information Networks (HINs), challenges such as expressiveness limitations and over-smoothing have prompted research…
Graph Representation LearningNode ClusteringRepresentation LearningDMGCRN: Dynamic Multi-Graph Convolution Recurrent Network for Traffic Forecasting
Traffic forecasting is a problem of intelligent transportation systems (ITS) and crucial for individuals and public agencies. Therefore, researches pay great attention to deal with the complex spatio-temporal dependencie…
Get Rid of Suspended Animation Problem: Deep Diffusive Neural Network on Graph Semi-Supervised Classification
Existing graph neural networks may suffer from the "suspended animation problem" when the model architecture goes deep. Meanwhile, for some graph learning scenarios, e.g., nodes with text/image attributes or graphs with …
General ClassificationGraph LearningGraph Neural NetworkGraph Representation Learning+2Block Modeling-Guided Graph Convolutional Neural Networks
Graph Convolutional Network (GCN) has shown remarkable potential of exploring graph representation. However, the GCN aggregating mechanism fails to generalize to networks with heterophily where most nodes have neighbors …
Finding Global Homophily in Graph Neural Networks When Meeting Heterophily
We investigate graph neural networks on graphs with heterophily. Some existing methods amplify a node's neighborhood with multi-hop neighbors to include more nodes with homophily. However, it is a significant challenge t…
Node ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs