paper-with-me

홈 › Papers

Universal Link Predictor By In-Context Learning on Graphs

2024-02-12 · Kaiwen Dong, Haitao Mao, Zhichun Guo, Nitesh V. Chawla

Link prediction is a crucial task in graph machine learning, where the goal is to infer missing or future links within a graph. Traditional approaches leverage heuristic methods based on widely observed connectivity patterns, offering broad applicability and generalizability without the need for model training. Despite their utility, these methods are limited by their reliance on human-derived heuristics and lack the adaptability of data-driven approaches. Conversely, parametric link predictors excel in automatically learning the connectivity patterns from data and achieving state-of-the-art but fail short to directly transfer across different graphs. Instead, it requires the cost of extensive training and hyperparameter optimization to adapt to the target graph. In this work, we introduce the Universal Link Predictor (UniLP), a novel model that combines the generalizability of heuristic approaches with the pattern learning capabilities of parametric models. UniLP is designed to autonomously identify connectivity patterns across diverse graphs, ready for immediate application to any unseen graph dataset without targeted training. We address the challenge of conflicting connectivity patterns-arising from the unique distributions of different graphs-through the implementation of In-context Learning (ICL). This approach allows UniLP to dynamically adjust to various target graphs based on contextual demonstrations, thereby avoiding negative transfer. Through rigorous experimentation, we demonstrate UniLP's effectiveness in adapting to new, unseen graphs at test time, showcasing its ability to perform comparably or even outperform parametric models that have been finetuned for specific datasets. Our findings highlight UniLP's potential to set a new standard in link prediction, combining the strengths of heuristic and parametric methods in a single, versatile framework.

📄 PDF Abstract BibTeX arXiv:2402.07738

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter OptimizationIn-Context LearningLink Prediction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

TFMLinker: Universal Link Predictor by Graph In-Context Learning with Tabular Foundation Models

2026-02-09 · Tianyin Liao, Chunyu Hu, Yicheng Sui, Xingxuan Zhang 외 arxiv

Link prediction is a fundamental task in graph machine learning with widespread applications such as recommendation systems, drug discovery, knowledge graphs, etc. In the foundation model era, how to develop universal li…

Recommendation SystemsKnowledge GraphsLink PredictionDrug Discovery

Coordinate Constructions in English Enhanced Universal Dependencies: Analysis and Computational Modeling

2021-03-16 · EACL 2021 2 · Stefan Grünewald, Prisca Piccirilli, Annemarie Friedrich

In this paper, we address the representation of coordinate constructions in Enhanced Universal Dependencies (UD), where relevant dependency links are propagated from conjunction heads to other conjuncts. English treebank…

Accurate Link Prediction for Edge-Incomplete Graphs via PU Learning

2024-05-20 · Junghun Kim, Ka Hyun Park, Hoyoung Yoon, U Kang

Given an edge-incomplete graph, how can we accurately find the missing links? The link prediction in edge-incomplete graphs aims to discover the missing relations between entities when their relationships are represented…

Link Prediction

Link Prediction in Hypergraphs using Graph Convolutional Networks

2019-05-01 · ICLR 2019 5 · Naganand Yadati, Vikram Nitin, Madhav Nimishakavi, Prateek Yadav 외

Link prediction in simple graphs is a fundamental problem in which new links between nodes are predicted based on the observed structure of the graph. However, in many real-world applications, there is a need to model re…

Link PredictionPrediction

OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphs

2022-05-30 · Yangze Zhou, Gitta Kutyniok, Bruno Ribeiro

This work provides the first theoretical study on the ability of graph Message Passing Neural Networks (gMPNNs) -- such as Graph Neural Networks (GNNs) -- to perform inductive out-of-distribution (OOD) link prediction ta…

Link Prediction