paper-with-me

Papers

Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering

2023-09-20 · Yike Wu, Nan Hu, Sheng Bi, Guilin Qi, Jie Ren, Anhuan Xie, Wei Song

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language model approach for solving the knowledge graph question answering (KGQA) task that requires rich world knowledge. Existing work has shown that retrieving KG knowledge to enhance LLMs prompting can significantly improve LLMs performance in KGQA. However, their approaches lack a well-formed verbalization of KG knowledge, i.e., they ignore the gap between KG representations and textual representations. To this end, we propose an answer-sensitive KG-to-Text approach that can transform KG knowledge into well-textualized statements most informative for KGQA. Based on this approach, we propose a KG-to-Text enhanced LLMs framework for solving the KGQA task. Experiments on several KGQA benchmarks show that the proposed KG-to-Text augmented LLMs approach outperforms previous KG-augmented LLMs approaches regarding answer accuracy and usefulness of knowledge statements.

📄 PDF Abstract BibTeX arXiv:2309.11206

Code (1)

wuyike2000/retrieve-rewrite-answer 공식 구현 pytorch

Tasks

Graph Question AnsweringLanguage ModelingLanguage ModellingQuestion AnsweringWorld Knowledge

Similar Papers 제목 키워드 기반

CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering

2024-09-29 · Yike Wu, Yi Huang, Nan Hu, Yuncheng Hua 외

Recent studies have explored the use of Large Language Models (LLMs) with Retrieval Augmented Generation (RAG) for Knowledge Graph Question Answering (KGQA). They typically require rewriting retrieved subgraphs into natu…

Graph Question AnsweringQuestion AnsweringRAGRetrieval-augmented Generation

Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA

2024-09-23 · Nirmal Roy, Leonardo F. R. Ribeiro, Rexhina Blloshmi, Kevin Small

Augmenting Large Language Models (LLMs) with information retrieval capabilities (i.e., Retrieval-Augmented Generation (RAG)) has proven beneficial for knowledge-intensive tasks. However, understanding users' contextual s…

Conversational Question AnsweringInformation RetrievalPassage RetrievalQuestion Answering+4

R-Bot: An LLM-based Query Rewrite System

2024-12-02 · Zhaoyan Sun, Xuanhe Zhou, Guoliang Li

Query rewrite is essential for optimizing SQL queries to improve their execution efficiency without changing their results. Traditionally, this task has been tackled through heuristic and learning-based methods, each wit…

Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers

2024-06-16 · Tianhua Zhang, Kun Li, Hongyin Luo, Xixin Wu 외

Query rewriting is a crucial technique for passage retrieval in open-domain conversational question answering (CQA). It decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retr…

Conversational Question AnsweringPassage RetrievalQuestion AnsweringRetrieval

Query Rewriting for Retrieval-Augmented Large Language Models

2023-05-23 · Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao 외

Large Language Models (LLMs) play powerful, black-box readers in the retrieve-then-read pipeline, making remarkable progress in knowledge-intensive tasks. This work introduces a new framework, Rewrite-Retrieve-Read inste…

Language ModelingLanguage ModellingMultiple-choiceRetrieval+1