paper-with-me

Papers

OpenGraph: Towards Open Graph Foundation Models

2024-03-02 · Lianghao Xia, Ben Kao, Chao Huang

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.

📄 PDF Abstract BibTeX arXiv:2403.01121

Code (1)

hkuds/opengraph 공식 구현 pytorch

Tasks

Data AugmentationGraph LearningLanguage ModelingLanguage ModellingLarge Language ModelLink PredictionNode ClassificationRecommendation Systems

Methods 이 논문이 사용한 방법론

Attention 설명 없음
LapEigen 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
Laplacian PE Laplacian eigenvectors represent a natural generalization of the…

Similar Papers 제목 키워드 기반

OpenGraph: Open-Vocabulary Hierarchical 3D Graph Representation in Large-Scale Outdoor Environments

2024-03-14 · Yinan Deng, Jiahui Wang, Jingyu Zhao, Xinyu Tian 외

Environment representations endowed with sophisticated semantics are pivotal for facilitating seamless interaction between robots and humans, enabling them to effectively carry out various tasks. Open-vocabulary maps, po…

Zero-Shot Learning

GFT: Graph Foundation Model with Transferable Tree Vocabulary

2024-11-09 · Zehong Wang, Zheyuan Zhang, Nitesh V Chawla, Chuxu Zhang 외

Inspired by the success of foundation models in applications such as ChatGPT, as graph data has been ubiquitous, one can envision the far-reaching impacts that can be brought by Graph Foundation Models (GFMs) with broade…

Drug DiscoveryGraph Learning

Graph Foundation Models: A Comprehensive Survey

2025-05-21 · Zehong Wang, Zheyuan Liu, Tianyi Ma, Jiazheng Li 외

Graph-structured data pervades domains such as social networks, biological systems, knowledge graphs, and recommender systems. While foundation models have transformed natural language processing, vision, and multimodal …

Graph LearningKnowledge GraphsRecommendation SystemsSurvey

Billion-Scale Graph Foundation Models

2026-02-04 · Maya Bechler-Speicher, Yoel Gottlieb, Andrey Isakov, David Abensur 외 arxiv

Graph-structured data underpins many critical applications. While foundation models have transformed language and vision via large-scale pretraining and lightweight adaptation, extending this paradigm to general, real-wo…

Graph Learning

Open-Set Semantic Uncertainty Aware Metric-Semantic Graph Matching

2024-09-17 · Kurran Singh, John J. Leonard

Underwater object-level mapping requires incorporating visual foundation models to handle the uncommon and often previously unseen object classes encountered in marine scenarios. In this work, a metric of semantic uncert…

Graph MatchingLoop Closure DetectionObject