paper-with-me

홈 › Papers

Fine-Grained Stateful Knowledge Exploration: A Novel Paradigm for Integrating Knowledge Graphs with Large Language Models

2024-01-24 · Dehao Tao, Congqi Wang, Feng Huang, JunHao Chen, Yongfeng Huang, Minghu Jiang

Large Language Models (LLMs) have shown impressive capabilities, yet updating their knowledge remains a significant challenge, often leading to outdated or inaccurate responses. A proposed solution is the integration of external knowledge bases, such as knowledge graphs, with LLMs. Most existing methods use a paradigm that treats the question as the objective, with relevant knowledge being incrementally retrieved from the knowledge graph. However, this strategy frequently experiences an mismatch in the granularity of knowledge between the target question and the entities and relations being retrieved. As a result, the information in the question cannot precisely correspond to the retrieved knowledge. This may cause redundant exploration or omission of vital knowledge, thereby leading to enhanced computational consumption and reduced retrieval accuracy. In this paper, we propose a novel paradigm of fine-grained stateful knowledge exploration, which addresses the `information granularity mismatch' issue. We extract fine-grained information from questions and explore the semantic mapping between this information and the knowledge in graph. By dynamically updating the mapping records, we avoid redundant exploration and ensure no pertinent information is overlooked, thereby reducing computational overhead and improving the accuracy of knowledge exploration. The use of fine-grained information also eliminates the need for a priori knowledge, a common requirement in existing methods. Experiments on multiple datasets revealed that our paradigm surpasses current advanced methods in knowledge retrieval while significantly reducing the average number of LLM invocations.

📄 PDF Abstract BibTeX arXiv:2401.13444

Code (1)

nnnoidea/stateful-KGQA 공식 구현

Tasks

Knowledge Base Question AnsweringKnowledge GraphsQuestion AnsweringRetrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

MuSEAgent: A Multimodal Reasoning Agent with Stateful Experiences

2026-03-29 · Shijian Wang, Jiarui Jin, Runhao Fu, Zexuan Yan 외 arxiv

Research agents have recently achieved significant progress in information seeking and synthesis across heterogeneous textual and visual sources. In this paper, we introduce MuSEAgent, a multimodal reasoning agent that e…

Multimodal Reasoning

StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery

2026-06-10 · Jiayao Chen, Shi Liu, Linyi Yang arxiv

Open-ended scientific discovery asks agents to move beyond executing analyses for predefined questions. Across multiple rounds of exploration, a discovery agent must decide which phenomena warrant investigation while avo…

Stateful Visual Encoders for Vision-Language Models

2026-06-03 · Zirui Wang, Junwei Yu, Adam Yala, David M. Chan 외 arxiv

Vision-language models (VLMs) are increasingly used in multi-image, multi-turn agentic settings where decisions depend on visual changes. However, in existing open-weight VLMs, visual comparisons happen only inside the l…

DeepCruiser: Automated Guided Testing for Stateful Deep Learning Systems

2018-12-13 · Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma 외

Deep learning (DL) defines a data-driven programming paradigm that automatically composes the system decision logic from the training data. In company with the data explosion and hardware acceleration during the past dec…

Deep LearningSpeech-to-Text

Exploration and Incentives in Reinforcement Learning

2021-02-28 · Max Simchowitz, Aleksandrs Slivkins

How do you incentivize self-interested agents to $\textit{explore}$ when they prefer to $\textit{exploit}$? We consider complex exploration problems, where each agent faces the same (but unknown) MDP. In contrast with tr…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)