paper-with-me

홈 › Papers

Encoder-Free Knowledge-Graph Reasoning with LLMs via Hyperdimensional Path Retrieval

2025-12-10 · Yezi Liu, William Youngwoo Chung, Hanning Chen, Calvin Yeung, Mohsen Imani arxiv

Recent progress in large language models (LLMs) has made knowledge-grounded reasoning increasingly practical, yet KG-based QA systems often pay a steep price in efficiency and transparency. In typical pipelines, symbolic paths are scored by neural encoders or repeatedly re-ranked by multiple LLM calls, which inflates latency and GPU cost and makes the decision process hard to audit. We introduce PathHD, an encoder-free framework for knowledge-graph reasoning that couples hyperdimensional computing (HDC) with a single LLM call per query. Given a query, PathHD represents relation paths as block-diagonal GHRR hypervectors, retrieves candidate paths using a calibrated blockwise cosine similarity with Top-K pruning, and then performs a one-shot LLM adjudication that outputs the final answer together with supporting, citeable paths. The design is enabled by three technical components: (i) an order-sensitive, non-commutative binding operator for composing multi-hop paths, (ii) a robust similarity calibration that stabilizes hypervector retrieval, and (iii) an adjudication stage that preserves interpretability while avoiding per-path LLM scoring. Across WebQSP, CWQ, and GrailQA, PathHD matches or improves Hits@1 compared to strong neural baselines while using only one LLM call per query, reduces end-to-end latency by $40-60\%$, and lowers GPU memory by $3-5\times$ due to encoder-free retrieval. Overall, the results suggest that carefully engineered HDC path representations can serve as an effective substrate for efficient and faithful KG-LLM reasoning, achieving a strong accuracy-efficiency-interpretability trade-off.

📄 PDF Abstract BibTeX arXiv:2512.09369

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

2024-02-07 · Yihao Li, Ru Zhang, Jianyi Liu

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations,…

Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains

2024-10-24 · Kun Li, Tianhua Zhang, Xixin Wu, Hongyin Luo 외

Knowledge Graphs (KGs) can serve as reliable knowledge sources for question answering (QA) due to their structured representation of knowledge. Existing research on the utilization of KG for large language models (LLMs) …

Knowledge GraphsQuestion Answering

Beyond Textual Context: Structural Graph Encoding with Adaptive Space Alignment to alleviate the hallucination of LLMs

2025-09-26 · Yifang Zhang, Pengfei Duan, Yiwen Yang, Shengwu Xiong arxiv

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information…

Knowledge Graphs

KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation

2024-12-30 · Siyuan Fang, Kaijing Ma, Tianyu Zheng, Xinrun Du 외

Large language models (LLMs) demonstrate exceptional performance across a variety of tasks, yet they are often affected by hallucinations and the timeliness of knowledge. Leveraging knowledge graphs (KGs) as external kno…

Decision MakingGraph Question AnsweringKnowledge GraphsQuestion Answering

Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

2023-07-15 · Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Saizhuo Wang 외

Although large language models (LLMs) have achieved significant success in various tasks, they often struggle with hallucination problems, especially in scenarios requiring deep and responsible reasoning. These issues co…

HallucinationKnowledge GraphsLanguage ModelingLanguage Modelling+2