paper-with-me

Papers

Hyperbolic Graph Neural Networks at Scale: A Meta Learning Approach

2023-10-29 · NeurIPS 2023 11

The progress in hyperbolic neural networks (HNNs) research is hindered by their absence of inductive bias mechanisms, which are essential for generalizing to new tasks and facilitating scalable learning over large datasets. In this paper, we aim to alleviate these issues by learning generalizable inductive biases from the nodes' local subgraph and transfer them for faster learning over new subgraphs with a disjoint set of nodes, edges, and labels in a few-shot setting. We introduce a novel method, Hyperbolic GRAph Meta Learner (H-GRAM), that, for the tasks of node classification and link prediction, learns transferable information from a set of support local subgraphs in the form of hyperbolic meta gradients and label hyperbolic protonets to enable faster learning over a query set of new tasks dealing with disjoint subgraphs. Furthermore, we show that an extension of our meta-learning framework also mitigates the scalability challenges seen in HNNs faced by existing approaches. Our comparative analysis shows that H-GRAM effectively learns and transfers information in multiple challenging few-shot settings compared to other state-of-the-art baselines. Additionally, we demonstrate that, unlike standard HNNs, our approach is able to scale over large graph datasets and improve performance over its Euclidean counterparts.

📄 PDF Abstract BibTeX arXiv:2310.18918

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasLink PredictionMeta-LearningNode Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Metapath-based Hyperbolic Contrastive Learning for Heterogeneous Graph Embedding

2025-06-20 · Jongmin Park, SeungHoon Han, Won-Yong Shin, Sungsu Lim

The hyperbolic space, characterized by a constant negative curvature and exponentially expanding space, aligns well with the structural properties of heterogeneous graphs. However, although heterogeneous graphs inherentl…

Contrastive LearningGraph Embedding

Text Enriched Sparse Hyperbolic Graph Convolutional Networks

2022-07-06 · Nurendra Choudhary, Nikhil Rao, Karthik Subbian, Chandan K. Reddy

Heterogeneous networks, which connect informative nodes containing text with different edge types, are routinely used to store and process information in various real-world applications. Graph Neural Networks (GNNs) and …

Language ModellingLink Prediction

Hyperbolic Heterogeneous Graph Attention Networks

2024-04-15 · Jongmin Park, SeungHoon Han, Soohwan Jeong, Sungsu Lim

Most previous heterogeneous graph embedding models represent elements in a heterogeneous graph as vector representations in a low-dimensional Euclidean space. However, because heterogeneous graphs inherently possess comp…

ClusteringGraph AttentionGraph EmbeddingNode Classification

Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion

2026-04-30 · Yonghao Liu, Jialu Sun, Wei Pang, Fausto Giunchiglia 외 arxiv

Graph few-shot learning, which focuses on effectively learning from only a small number of labeled nodes to quickly adapt to new tasks, has garnered significant research attention. Despite recent advances in graph few-sh…

Representation LearningFew-Shot Learning

Hyperbolic Graph Convolutional Neural Networks

2019-10-28 · NeurIPS 2019 12 · Ines Chami, Rex Ying, Christopher Ré, Jure Leskovec

Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space, which has been shown to incur a large distortion when embedding real-world graphs with scale-free or hierarchical structure. Hyperbo…

Link PredictionNode Classification