Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
Knowledge graph question answering (KGQA) involves answering natural language questions by leveraging structured information stored in a knowledge graph. Typically, KGQA initially retrieve a targeted subgraph from a large-scale knowledge graph, which serves as the basis for reasoning models to address queries. However, the retrieved subgraph inevitably brings distraction information for knowledge utilization, impeding the model's ability to perform accurate reasoning. To address this issue, we propose a Question-guided Knowledge Graph Re-scoring method (Q-KGR) to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. Moreover, we introduce Knowformer, a parameter-efficient method for injecting the re-scored knowledge graph into large language models to enhance their ability to perform factual reasoning. Extensive experiments on multiple KGQA benchmarks demonstrate the superiority of our method over existing systems.
Code (1)
Tasks
Graph Question AnsweringQuestion AnsweringSimilar Papers 제목 키워드 기반
Llama SLayer 8B: Shallow Layers Hold the Key to Knowledge Injection
As a manner to augment pre-trained large language models (LLM), knowledge injection is critical to develop vertical domain large models and has been widely studied. Although most current approaches, including parameter-e…
Mathparameter-efficient fine-tuningQuestion AnsweringLaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
Visual question answering (VQA) often requires an understanding of visual concepts and language semantics, which relies on external knowledge. Most existing methods exploit pre-trained language models or/and unstructured…
DecoderKnowledge GraphsQuestion AnsweringText Generation+2SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection
Nowadays, the importance of software with natural-language user interfaces cannot be underestimated. In particular, in Question Answering (QA) systems, generating a SPARQL query for a given natural-language question (oft…
Question AnsweringKnowledge GraphsQuery-Aware Graph Neural Networks for Enhanced Retrieval-Augmented Generation
We present a novel graph neural network (GNN) architecture for retrieval-augmented generation (RAG) that leverages query-aware attention mechanisms and learned scoring heads to improve retrieval accuracy on complex, mult…
Graph Neural NetworkQuestion AnsweringKnowledge GraphsPhysical Prompt Injection Attacks on Large Vision-Language Models
Large Vision-Language Models (LVLMs) are increasingly deployed in real-world intelligent systems for perception and reasoning in open physical environments. While LVLMs are known to be vulnerable to prompt injection atta…
Visual Question Answering