paper-with-me

Papers

Hyperbolic Graph Convolutional Neural Networks

2019-10-28 · NeurIPS 2019 12 · Ines Chami, Rex Ying, Christopher Ré, Jure Leskovec

Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space, which has been shown to incur a large distortion when embedding real-world graphs with scale-free or hierarchical structure. Hyperbolic geometry offers an exciting alternative, as it enables embeddings with much smaller distortion. However, extending GCNs to hyperbolic geometry presents several unique challenges because it is not clear how to define neural network operations, such as feature transformation and aggregation, in hyperbolic space. Furthermore, since input features are often Euclidean, it is unclear how to transform the features into hyperbolic embeddings with the right amount of curvature. Here we propose Hyperbolic Graph Convolutional Neural Network (HGCN), the first inductive hyperbolic GCN that leverages both the expressiveness of GCNs and hyperbolic geometry to learn inductive node representations for hierarchical and scale-free graphs. We derive GCN operations in the hyperboloid model of hyperbolic space and map Euclidean input features to embeddings in hyperbolic spaces with different trainable curvature at each layer. Experiments demonstrate that HGCN learns embeddings that preserve hierarchical structure, and leads to improved performance when compared to Euclidean analogs, even with very low dimensional embeddings: compared to state-of-the-art GCNs, HGCN achieves an error reduction of up to 63.1% in ROC AUC for link prediction and of up to 47.5% in F1 score for node classification, also improving state-of-the art on the Pubmed dataset.

📄 PDF Abstract BibTeX arXiv:1910.12933

Code (3)

CUAI/Riemannian-Residual-Neural-Networks pytorch
HazyResearch/hgcn pytorch
ydtydr/hyla pytorch

Tasks

Link PredictionNode Classification

Methods 이 논문이 사용한 방법론

GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

A Hyperbolic-to-Hyperbolic Graph Convolutional Network

2021-04-14 · CVPR 2021 1 · Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia

Hyperbolic graph convolutional networks (GCNs) demonstrate powerful representation ability to model graphs with hierarchical structure. Existing hyperbolic GCNs resort to tangent spaces to realize graph convolution on hy…

General ClassificationGraph ClassificationLink PredictionNode Classification

Lorentzian Graph Convolutional Networks

2021-04-15 · Yiding Zhang, Xiao Wang, Chuan Shi, Nian Liu 외

Graph convolutional networks (GCNs) have received considerable research attention recently. Most GCNs learn the node representations in Euclidean geometry, but that could have a high distortion in the case of embedding g…

DeepHGCN: Toward Deeper Hyperbolic Graph Convolutional Networks

2023-10-03 · Jiaxu Liu, Xinping Yi, Xiaowei Huang

Hyperbolic graph convolutional networks (HGCNs) have demonstrated significant potential in extracting information from hierarchical graphs. However, existing HGCNs are limited to shallow architectures due to the computat…

Computational EfficiencyLink PredictionNode Classification

Residual Hyperbolic Graph Convolution Networks

2024-12-05 · Yangkai Xue, Jindou Dai, Zhipeng Lu, Yuwei Wu 외

Hyperbolic graph convolutional networks (HGCNs) have demonstrated representational capabilities of modeling hierarchical-structured graphs. However, as in general GCNs, over-smoothing may occur as the number of model lay…

Neural Networks in a Product of Hyperbolic Spaces

2022-07-01 · NAACL (ACL) 2022 7 · Jun Takeuchi, Noriki Nishida, Hideki Nakayama

Machine learning in hyperbolic spaces has attracted much attention in natural language processing and many other fields. In particular, Hyperbolic Neural Networks (HNNs) have improved a wide variety of tasks, from machin…

Graph EmbeddingKnowledge Graph EmbeddingMachine TranslationNode Classification