paper-with-me

Papers

Continuous Geometry-Aware Graph Diffusion via Hyperbolic Neural PDE

2024-06-03 · Jiaxu Liu, Xinping Yi, Sihao Wu, Xiangyu Yin, Tianle Zhang, Xiaowei Huang, Shi Jin

While Hyperbolic Graph Neural Network (HGNN) has recently emerged as a powerful tool dealing with hierarchical graph data, the limitations of scalability and efficiency hinder itself from generalizing to deep models. In this paper, by envisioning depth as a continuous-time embedding evolution, we decouple the HGNN and reframe the information propagation as a partial differential equation, letting node-wise attention undertake the role of diffusivity within the Hyperbolic Neural PDE (HPDE). By introducing theoretical principles \textit{e.g.,} field and flow, gradient, divergence, and diffusivity on a non-Euclidean manifold for HPDE integration, we discuss both implicit and explicit discretization schemes to formulate numerical HPDE solvers. Further, we propose the Hyperbolic Graph Diffusion Equation (HGDE) -- a flexible vector flow function that can be integrated to obtain expressive hyperbolic node embeddings. By analyzing potential energy decay of embeddings, we demonstrate that HGDE is capable of modeling both low- and high-order proximity with the benefit of local-global diffusivity functions. Experiments on node classification and link prediction and image-text classification tasks verify the superiority of the proposed method, which consistently outperforms various competitive models by a significant margin.

📄 PDF Abstract BibTeX arXiv:2406.01282

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkImage-text ClassificationLink PredictionNode Classificationtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Hyperbolic Diffusion Embedding and Distance for Hierarchical Representation Learning

2023-05-30 · Ya-Wei Eileen Lin, Ronald R. Coifman, Gal Mishne, Ronen Talmon

Finding meaningful representations and distances of hierarchical data is important in many fields. This paper presents a new method for hierarchical data embedding and distance. Our method relies on combining diffusion g…

Graph EmbeddingRepresentation Learning

Non-linear Embeddings in Hilbert Simplex Geometry

2022-03-22 · Frank Nielsen, Ke Sun

A key technique of machine learning and computer vision is to embed discrete weighted graphs into continuous spaces for further downstream processing. Embedding discrete hierarchical structures in hyperbolic geometry has…

A Geometry-Aware Algorithm to Learn Hierarchical Embeddings in Hyperbolic Space

2024-07-23 · ICLR Workshop GTRL 2021 5 · Zhangyu Wang, Lantian Xu, Zhifeng Kong, Weilong Wang 외

Hyperbolic embeddings are a class of representation learning methods that offer competitive performances when data can be abstracted as a tree-like graph. However, in practice, learning hyperbolic embeddings of hierarchi…

Representation Learning

Lorentzian Graph Convolutional Networks

2021-04-15 · Yiding Zhang, Xiao Wang, Chuan Shi, Nian Liu 외

Graph convolutional networks (GCNs) have received considerable research attention recently. Most GCNs learn the node representations in Euclidean geometry, but that could have a high distortion in the case of embedding g…

Time-aware Hyperbolic Graph Attention Network for Session-based Recommendation

2023-01-10 · Xiaohan Li, Yuqing Liu, Zheng Liu, Philip S. Yu

Session-based Recommendation (SBR) is to predict users' next interested items based on their previous browsing sessions. Existing methods model sessions as graphs or sequences to estimate user interests based on their in…

Graph AttentionGraph Neural NetworkSession-Based Recommendations