Entropy Aware Message Passing in Graph Neural Networks
Deep Graph Neural Networks struggle with oversmoothing. This paper introduces a novel, physics-inspired GNN model designed to mitigate this issue. Our approach integrates with existing GNN architectures, introducing an entropy-aware message passing term. This term performs gradient ascent on the entropy during node aggregation, thereby preserving a certain degree of entropy in the embeddings. We conduct a comparative analysis of our model against state-of-the-art GNNs across various common datasets.
Code (1)
Tasks
Node ClassificationSimilar Papers 제목 키워드 기반
Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Network
Recent scene graph generation (SGG) frameworks have focused on learning complex relationships among multiple objects in an image. Thanks to the nature of the message passing neural network (MPNN) that models high-order i…
Graph GenerationRelationRepresentation LearningScene Graph GenerationTree-AMP: Compositional Inference with Tree Approximate Message Passing
We introduce Tree-AMP, standing for Tree Approximate Message Passing, a python package for compositional inference in high-dimensional tree-structured models. The package provides a unifying framework to study several ap…
River of No Return: Graph Percolation Embeddings for Efficient Knowledge Graph Reasoning
We study Graph Neural Networks (GNNs)-based embedding techniques for knowledge graph (KG) reasoning. For the first time, we link the path redundancy issue in the state-of-the-art KG reasoning models based on path encodin…
BeMap: Balanced Message Passing for Fair Graph Neural Network
Fairness in graph neural networks has been actively studied recently. However, existing works often do not explicitly consider the role of message passing in introducing or amplifying the bias. In this paper, we first in…
FairnessGraph Neural NetworkNode ClassificationHeterophilic Graph Neural Networks Optimization with Causal Message-passing
In this work, we discover that causal inference provides a promising approach to capture heterophilic message-passing in Graph Neural Network (GNN). By leveraging cause-effect analysis, we can discern heterophilic edges …
Causal InferenceGraph LearningGraph Neural NetworkLink Prediction+1