Position: How can Graphs Help Large Language Models?
With the rapid advancement of large language models (LLMs), classic graph learning tasks have greatly benefited from LLMs, including improved encoding of textual features, more efficient construction of graphs from text, and enhanced reasoning over knowledge graphs. In this paper, we ask a complementary question: How can graphs help LLMs? We address this question from three perspectives: 1) graphs provide an up-to-date knowledge source that helps reduce LLM hallucinations, 2) graph-based prompting techniques-such as Chain-of-Thought (CoT), Tree-of-Thought (ToT), and Graph-of-Thought (GoT)-enhance LLM reasoning capabilities, and 3) integrating graphs into LLMs improves their understanding of structured data, expanding their applicability to domains such as e-commerce, code, and relational databases (RDBs). We further outlook some future directions including designing sparse LLM architectures based on graphs and brain-inspired memory systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsGraph LearningSimilar Papers 제목 키워드 기반
Semantic Graphs for Syntactic Simplification: A Revisit from the Age of LLM
Symbolic sentence meaning representations, such as AMR (Abstract Meaning Representation) provide expressive and structured semantic graphs that act as intermediates that simplify downstream NLP tasks. However, the instru…
Abstract Meaning RepresentationInstruction FollowingSentenceTopology-aware Tensor Decomposition for Meta-graph Learning
Heterogeneous graphs generally refers to graphs with different types of nodes and edges. A common approach for extracting useful information from heterogeneous graphs is to use meta-graphs, which can be seen as a special…
Graph LearningKnowledge GraphsNeural Architecture SearchNode Classification+1Neurosymbolic artificial intelligence via large language models and coherence-driven inference
We devise an algorithm to generate sets of propositions that objectively instantiate graphs that support coherence-driven inference. We then benchmark the ability of large language models (LLMs) to reconstruct coherence …
ReGrAt: Regularization in Graphs using Attention to handle class imbalance
Node classification is an important task to solve in graph-based learning. Even though a lot of work has been done in this field, imbalance is neglected. Real-world data is not perfect, and is imbalanced in representatio…
ClassificationNode ClassificationStatistical estimation for optimization problems on graphs
Large graphs abound in machine learning, data mining, and several related areas. A useful step towards analyzing such graphs is that of obtaining certain summary statistics - e.g., or the expected length of a shortest pa…
Combinatorial OptimizationPosition