paper-with-me

Papers

Node Embedding from Hamiltonian Information Propagation in Graph Neural Networks

2023-03-02 · Qiyu Kang, Kai Zhao, Yang song, Sijie Wang, Rui She, Wee Peng Tay

Graph neural networks (GNNs) have achieved success in various inference tasks on graph-structured data. However, common challenges faced by many GNNs in the literature include the problem of graph node embedding under various geometries and the over-smoothing problem. To address these issues, we propose a novel graph information propagation strategy called Hamiltonian Dynamic GNN (HDG) that uses a Hamiltonian mechanics approach to learn node embeddings in a graph. The Hamiltonian energy function in HDG is learnable and can adapt to the underlying geometry of any given graph dataset. We demonstrate the ability of HDG to automatically learn the underlying geometry of graph datasets, even those with complex and mixed geometries, through comprehensive evaluations against state-of-the-art baselines on various downstream tasks. We also verify that HDG is stable against small perturbations and can mitigate the over-smoothing problem when stacking many layers.

📄 PDF Abstract BibTeX arXiv:2303.01030

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Node Embedding from Neural Hamiltonian Orbits in Graph Neural Networks

2023-05-30 · Qiyu Kang, Kai Zhao, Yang song, Sijie Wang 외

In the graph node embedding problem, embedding spaces can vary significantly for different data types, leading to the need for different GNN model types. In this paper, we model the embedding update of a node feature as …

Graph EmbeddingLink PredictionNode Classification

Symplectic Structure-Aware Hamiltonian (Graph) Embeddings

2023-09-09 · Jiaxu Liu, Xinping Yi, Tianle Zhang, Xiaowei Huang

In traditional Graph Neural Networks (GNNs), the assumption of a fixed embedding manifold often limits their adaptability to diverse graph geometries. Recently, Hamiltonian system-inspired GNNs have been proposed to addr…

Node ClassificationRiemannian optimization

Port-Hamiltonian Architectural Bias for Long-Range Propagation in Deep Graph Networks

2024-05-27 · Simon Heilig, Alessio Gravina, Alessandro Trenta, Claudio Gallicchio 외

The dynamics of information diffusion within graphs is a critical open issue that heavily influences graph representation learning, especially when considering long-range propagation. This calls for principled approaches…

Graph Representation LearningRepresentation Learning

Hyperedge Interaction-aware Hypergraph Neural Network

2024-01-28 · Rongping Ye, Xiaobing Pei, Haoran Yang, Ruiqi Wang

Hypergraphs provide an effective modeling approach for modeling high-order relationships in many real-world datasets. To capture such complex relationships, several hypergraph neural networks have been proposed for learn…

Cyclic Label Propagation for Graph Semi-supervised Learning

2020-11-24 · Zhao Li, Yixin Liu, Zhen Zhang, Shirui Pan 외

Graph neural networks (GNNs) have emerged as effective approaches for graph analysis, especially in the scenario of semi-supervised learning. Despite its success, GNN often suffers from over-smoothing and over-fitting pr…

Node Classification