Automatic Question-Answer Generation for Long-Tail Knowledge
Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties in learning about uncommon long-tail knowledge (tail entities). Since manually constructing QA datasets demands substantial human resources, the types of existing QA datasets are limited, leaving us with a scarcity of datasets to study the performance of LLMs on tail entities. In this paper, we propose an automatic approach to generate specialized QA datasets for tail entities and present the associated research challenges. We conduct extensive experiments by employing pretrained LLMs on our newly generated long-tail QA datasets, comparing their performance with and without external resources including Wikipedia and Wikidata knowledge graphs.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer GenerationKnowledge GraphsOpen-Domain Question AnsweringQuestion-Answer-GenerationQuestion AnsweringSimilar Papers 제목 키워드 기반
Read before Generate! Faithful Long Form Question Answering with Machine Reading
Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …
Answer GenerationFormLong Form Question AnsweringQuestion Answering+1Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation
We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the eme…
Question AnsweringQuestion GenerationQuestion-GenerationReading ComprehensionTowards Automatic Generation of Questions from Long Answers
Automatic question generation (AQG) has broad applicability in domains such as tutoring systems, conversational agents, healthcare literacy, and information retrieval. Existing efforts at AQG have been limited to short a…
Information RetrievalNatural QuestionsQuestion GenerationQuestion-Generation+2Long-form Question Answering: An Iterative Planning-Retrieval-Generation Approach
Long-form question answering (LFQA) poses a challenge as it involves generating detailed answers in the form of paragraphs, which go beyond simple yes/no responses or short factual answers. While existing QA models excel…
FormLong Form Question AnsweringQuestion AnsweringRetrievalLong-Form Answers to Visual Questions from Blind and Low Vision People
Vision language models can now generate long-form answers to questions about images - long-form visual question answers (LFVQA). We contribute VizWiz-LF, a dataset of long-form answers to visual questions posed by blind …
FormVisual Question Answering (VQA)