paper-with-me

홈 › Papers

Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning

2017-11-15 · ICLR 2018 1 · Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishnamurthy, Alex Smola, Andrew McCallum

Knowledge bases (KB), both automatically and manually constructed, are often incomplete --- many valid facts can be inferred from the KB by synthesizing existing information. A popular approach to KB completion is to infer new relations by combinatory reasoning over the information found along other paths connecting a pair of entities. Given the enormous size of KBs and the exponential number of paths, previous path-based models have considered only the problem of predicting a missing relation given two entities or evaluating the truth of a proposed triple. Additionally, these methods have traditionally used random paths between fixed entity pairs or more recently learned to pick paths between them. We propose a new algorithm MINERVA, which addresses the much more difficult and practical task of answering questions where the relation is known, but only one entity. Since random walks are impractical in a setting with combinatorially many destinations from a start node, we present a neural reinforcement learning approach which learns how to navigate the graph conditioned on the input query to find predictive paths. Empirically, this approach obtains state-of-the-art results on several datasets, significantly outperforming prior methods.

📄 PDF Abstract BibTeX arXiv:1711.05851

Code (8)

shehzaadzd/MINERVA 공식 구현 tf
JohnKurian/R2D2 tf
laurendelong21/mars
liu-yushan/PoLo tf
m-hildebrandt/R2D2 tf
marina-sp/reinform pytorch
markWJJ/rl tf
ty4b112/pytorch_MINERVA pytorch

Tasks

NavigateReinforcement LearningRelationvalid

Similar Papers 제목 키워드 기반

Learning to Walk with Dual Agents for Knowledge Graph Reasoning

2021-12-23 · Denghui Zhang, Zixuan Yuan, Hao liu, Xiaodong Lin 외

Graph walking based on reinforcement learning (RL) has shown great success in navigating an agent to automatically complete various reasoning tasks over an incomplete knowledge graph (KG) by exploring multi-hop relationa…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Triggering Multi-Hop Reasoning for Question Answering in Language Models using Soft Prompts and Random Walks

2023-06-06 · Kanishka Misra, Cicero Nogueira dos santos, Siamak Shakeri

Despite readily memorizing world knowledge about entities, pre-trained language models (LMs) struggle to compose together two or more facts to perform multi-hop reasoning in question-answering tasks. In this work, we pro…

Knowledge GraphsQuestion AnsweringWorld Knowledge

CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation

2020-10-20 · EMNLP 2021 11 · Wenchang Ma, Ryuichi Takanobu, Minlie Huang

Growing interests have been attracted in Conversational Recommender Systems (CRS), which explore user preference through conversational interactions in order to make appropriate recommendation. However, there is still a …

Conversational RecommendationRecommendation SystemsResponse GenerationText Generation

GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculum

2026-03-30 · Shuwen Xu, Yao Xu, Jiaxiang Liu, Chenhao Yuan 외 arxiv

Agentic knowledge graph question answering (KGQA) requires an agent to iteratively interact with knowledge graphs (KGs), posing challenges in both training data scarcity and reasoning generalization. Specifically, existi…

Graph Question AnsweringReinforcement LearningKnowledge Graphs

Understanding Reasoning Ability of Language Models From the Perspective of Reasoning Paths Aggregation

2024-02-05 · Xinyi Wang, Alfonso Amayuelas, Kexun Zhang, Liangming Pan 외

Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning c…

Knowledge GraphsMath