Generative Long-form Question Answering: Relevance, Faithfulness and Succinctness
In this thesis, we investigated the relevance, faithfulness, and succinctness aspects of Long Form Question Answering (LFQA). LFQA aims to generate an in-depth, paragraph-length answer for a given question, to help bridge the gap between real scenarios and the existing open-domain QA models which can only extract short-span answers. LFQA is quite challenging and under-explored. Few works have been done to build an effective LFQA system. It is even more challenging to generate a good-quality long-form answer relevant to the query and faithful to facts, since a considerable amount of redundant, complementary, or contradictory information will be contained in the retrieved documents. Moreover, no prior work has been investigated to generate succinct answers. We are among the first to research the LFQA task. We pioneered the research direction to improve the answer quality in terms of 1) query-relevance, 2) answer faithfulness, and 3) answer succinctness.
Code (0)
등록된 구현이 없습니다.
Tasks
FormLong Form Question AnsweringQuestion AnsweringSimilar Papers 제목 키워드 기반
Fine-Grained Relevance Annotations for Multi-Task Document Ranking and Question Answering
There are many existing retrieval and question answering datasets. However, most of them either focus on ranked list evaluation or single-candidate question answering. This divide makes it challenging to properly evaluat…
Document RankingQuestion AnsweringRetrievalQuestion Relevance in Visual Question Answering
Free-form and open-ended Visual Question Answering systems solve the problem of providing an accurate natural language answer to a question pertaining to an image. Current VQA systems do not evaluate if the posed questio…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision
Current medical question answering systems have difficulty processing long, detailed and informally worded questions submitted by patients, called Consumer Health Questions (CHQs). To address this issue, we introduce a m…
Medical Question AnsweringQuestion AnsweringRetrievalQuestion Answering with Long Multiple-Span Answers
Answering questions in many real-world applications often requires complex and precise information excerpted from texts spanned across a long document. However, currently no such annotated dataset is publicly available, …
Question AnsweringSentenceMedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answering
Large Language Models (LLMs) have demonstrated remarkable performance on various medical question-answering (QA) benchmarks, including standardized medical exams. However, correct answers alone do not ensure correct logi…
Medical Question AnsweringQuestion AnsweringSentence