Improving Span-based Question Answering Systems with Coarsely Labeled Data
We study approaches to improve fine-grained short answer Question Answering models by integrating coarse-grained data annotated for paragraph-level relevance and show that coarsely annotated data can bring significant performance gains. Experiments demonstrate that the standard multi-task learning approach of sharing representations is not the most effective way to leverage coarse-grained annotations. Instead, we can explicitly model the latent fine-grained short answer variables and optimize the marginal log-likelihood directly or use a newly proposed \emph{posterior distillation} learning objective. Since these latent-variable methods have explicit access to the relationship between the fine and coarse tasks, they result in significantly larger improvements from coarse supervision.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task LearningQuestion AnsweringSimilar Papers 제목 키워드 기반
XTQA: Span-Level Explanations of the Textbook Question Answering
Textbook Question Answering (TQA) is a task that one should answer a diagram/non-diagram question given a large multi-modal context consisting of abundant essays and diagrams. We argue that the explainability of this tas…
Question AnsweringFew-Shot Upsampling for Protest Size Detection
We propose a new task and dataset for a common problem in social science research: "upsampling" coarse document labels to fine-grained labels or spans. We pose the problem in a question answering format, with the answers…
Language ModellingQuestion Answering$M^3 QuestionIng$: Multi-modal Multi-span Medical Question Answering
The growing adoption of AI in healthcare, particularly in preventive care, highlights the critical need for accessibility and precision in Medical Question Answering (MedQA). In recent years, significant efforts have bee…
Question AnsweringEnhancing In-Context Learning with Answer Feedback for Multi-Span Question Answering
Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question …
In-Context LearningKeyphrase ExtractionQuestion AnsweringQuestion Answering with Long Multiple-Span Answers
Answering questions in many real-world applications often requires complex and precise information excerpted from texts spanned across a long document. However, currently no such annotated dataset is publicly available, …
Question AnsweringSentence