Large Language Models Meet Knowledge Graphs to Answer Factoid Questions
Recently, it has been shown that the incorporation of structured knowledge into Large Language Models significantly improves the results for a variety of NLP tasks. In this paper, we propose a method for exploring pre-trained Text-to-Text Language Models enriched with additional information from Knowledge Graphs for answering factoid questions. More specifically, we propose an algorithm for subgraphs extraction from a Knowledge Graph based on question entities and answer candidates. Then, we procure easily interpreted information with Transformer-based models through the linearization of the extracted subgraphs. Final re-ranking of the answer candidates with the extracted information boosts Hits@1 scores of the pre-trained text-to-text language models by 4-6%.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsRe-RankingSimilar Papers 제목 키워드 기반
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph
Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in…
Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage Modelling+2Answer Candidate Type Selection: Text-to-Text Language Model for Closed Book Question Answering Meets Knowledge Graphs
Pre-trained Text-to-Text Language Models (LMs), such as T5 or BART yield promising results in the Knowledge Graph Question Answering (KGQA) task. However, the capacity of the models is limited and the quality decreases f…
Graph Question AnsweringKnowledge GraphsLanguage ModelingLanguage Modelling+2Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities
Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA strugg…
Knowledge GraphsNatural Language UnderstandingQuestion AnsweringSurveyPrecision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models
In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this …
DecoderKnowledge GraphsLanguage ModellingQuestion Answering+2An Online Question Answering System based on Sub-graph Searching
Knowledge graphs (KGs) have been widely used for question answering (QA) applications, especially the entity based QA. However, searching an-swers from an entire large-scale knowledge graph is very time-consuming and it …
Answer GenerationKnowledge GraphsQuestion Answering