paper-with-me

Papers

Automatic Question-Answer Generation for Long-Tail Knowledge

2024-03-03 · Rohan Kumar, Youngmin Kim, Sunitha Ravi, Haitian Sun, Christos Faloutsos, Ruslan Salakhutdinov, Minji Yoon

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties in learning about uncommon long-tail knowledge (tail entities). Since manually constructing QA datasets demands substantial human resources, the types of existing QA datasets are limited, leaving us with a scarcity of datasets to study the performance of LLMs on tail entities. In this paper, we propose an automatic approach to generate specialized QA datasets for tail entities and present the associated research challenges. We conduct extensive experiments by employing pretrained LLMs on our newly generated long-tail QA datasets, comparing their performance with and without external resources including Wikipedia and Wikidata knowledge graphs.

📄 PDF Abstract BibTeX arXiv:2403.01382

Code (0)

등록된 구현이 없습니다.

Tasks

Answer GenerationKnowledge GraphsOpen-Domain Question AnsweringQuestion-Answer-GenerationQuestion Answering

Similar Papers 제목 키워드 기반

Read before Generate! Faithful Long Form Question Answering with Machine Reading

2022-03-01 · Findings (ACL) 2022 5 · Dan Su, Xiaoguang Li, Jindi Zhang, Lifeng Shang 외

Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …

Answer GenerationFormLong Form Question AnsweringQuestion Answering+1

Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation

2024-05-31 · Bernd Bohnet, Kevin Swersky, Rosanne Liu, Pranjal Awasthi 외

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the eme…

Question AnsweringQuestion GenerationQuestion-GenerationReading Comprehension

Towards Automatic Generation of Questions from Long Answers

2020-04-10 · Shlok Kumar Mishra, Pranav Goel, Abhishek Sharma, Abhyuday Jagannatha 외

Automatic question generation (AQG) has broad applicability in domains such as tutoring systems, conversational agents, healthcare literacy, and information retrieval. Existing efforts at AQG have been limited to short a…

Information RetrievalNatural QuestionsQuestion GenerationQuestion-Generation+2

Long-form Question Answering: An Iterative Planning-Retrieval-Generation Approach

2023-11-15 · Pritom Saha Akash, Kashob Kumar Roy, Lucian Popa, Kevin Chen-Chuan Chang

Long-form question answering (LFQA) poses a challenge as it involves generating detailed answers in the form of paragraphs, which go beyond simple yes/no responses or short factual answers. While existing QA models excel…

FormLong Form Question AnsweringQuestion AnsweringRetrieval

Long-Form Answers to Visual Questions from Blind and Low Vision People

2024-08-12 · Mina Huh, Fangyuan Xu, Yi-Hao Peng, Chongyan Chen 외

Vision language models can now generate long-form answers to questions about images - long-form visual question answers (LFVQA). We contribute VizWiz-LF, a dataset of long-form answers to visual questions posed by blind …

FormVisual Question Answering (VQA)