paper-with-me

홈 › Papers

Integrating Graphs with Large Language Models: Methods and Prospects

2023-10-09 · Shirui Pan, Yizhen Zheng, Yixin Liu

Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data type, is pervasive in real-world scenarios. Merging the capabilities of LLMs with graph-structured data has been a topic of keen interest. This paper bifurcates such integrations into two predominant categories. The first leverages LLMs for graph learning, where LLMs can not only augment existing graph algorithms but also stand as prediction models for various graph tasks. Conversely, the second category underscores the pivotal role of graphs in advancing LLMs. Mirroring human cognition, we solve complex tasks by adopting graphs in either reasoning or collaboration. Integrating with such structures can significantly boost the performance of LLMs in various complicated tasks. We also discuss and propose open questions for integrating LLMs with graph-structured data for the future direction of the field.

📄 PDF Abstract BibTeX arXiv:2310.05499

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationGraph Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Synergizing Knowledge Graphs with Large Language Models: A Comprehensive Review and Future Prospects

2024-07-26 · Daifeng Li, Fan Xu

Recent advancements have witnessed the ascension of Large Language Models (LLMs), endowed with prodigious linguistic capabilities, albeit marred by shortcomings including factual inconsistencies and opacity. Conversely, …

Knowledge Graphs

Graph Learning and Its Advancements on Large Language Models: A Holistic Survey

2022-12-17 · Shaopeng Wei, Jun Wang, Yu Zhao, Xingyan Chen 외

Graph learning is a prevalent domain that endeavors to learn the intricate relationships among nodes and the topological structure of graphs. Over the years, graph learning has transcended from graph theory to graph data…

Graph LearningRepresentation Learning

Trouble with the Curve: Predicting Future MLB Players Using Scouting Reports

2019-10-21 · Jacob Danovitch

In baseball, a scouting report profiles a player's characteristics and traits, usually intended for use in player valuation. This work presents a first-of-its-kind dataset of almost 10,000 scouting reports for minor leag…

Articles

Few-shot Learning on Heterogeneous Graphs: Challenges, Progress, and Prospects

2024-03-10 · Pengfei Ding, Yan Wang, Guanfeng Liu

Few-shot learning on heterogeneous graphs (FLHG) is attracting more attention from both academia and industry because prevailing studies on heterogeneous graphs often suffer from label sparsity. FLHG aims to tackle the p…

Few-Shot Learning

Are Large Language Models Suitable for Graph Computation? Progress and Prospects

2026-06-05 · Yuting Zhang, Yi Han, Kai Wang, Wei Ni 외 arxiv

Large language models (LLMs) have been increasingly explored for graph computation, where tasks require reasoning over structured relationships and algorithmic operations. Yet, it remains unclear when LLMs can reliably s…

Graph Learning