paper-with-me

홈 › Papers

Correct after Answer: Enhancing Multi-Span Question Answering with Post-Processing Method

2024-10-22 · Jiayi Lin, Chenyang Zhang, Haibo Tong, Dongyu Zhang, Qingqing Hong, Bingxuan Hou, Junli Wang

Multi-Span Question Answering (MSQA) requires models to extract one or multiple answer spans from a given context to answer a question. Prior work mainly focuses on designing specific methods or applying heuristic strategies to encourage models to predict more correct predictions. However, these models are trained on gold answers and fail to consider the incorrect predictions. Through a statistical analysis, we observe that models with stronger abilities do not predict less incorrect predictions compared with other models. In this work, we propose Answering-Classifying-Correcting (ACC) framework, which employs a post-processing strategy to handle incorrect predictions. Specifically, the ACC framework first introduces a classifier to classify the predictions into three types and exclude "wrong predictions", then introduces a corrector to modify "partially correct predictions". Experiments on several MSQA datasets show that ACC framework significantly improves the Exact Match (EM) scores, and further analysis demostrates that ACC framework efficiently reduces the number of incorrect predictions, improving the quality of predictions.

📄 PDF Abstract BibTeX arXiv:2410.16788

Code (1)

tongjinlp/acc 공식 구현 pytorch

Tasks

Question Answering

Similar Papers 제목 키워드 기반

Enhancing In-Context Learning with Answer Feedback for Multi-Span Question Answering

2023-06-07 · Zixian Huang, Jiaying Zhou, Gengyang Xiao, Gong Cheng

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question …

In-Context LearningKeyphrase ExtractionQuestion Answering

Time-Aware Representation Learning for Time-Sensitive Question Answering

2023-10-19 · Jungbin Son, Alice Oh

Time is one of the crucial factors in real-world question answering (QA) problems. However, language models have difficulty understanding the relationships between time specifiers, such as 'after' and 'before', and numbe…

Question AnsweringRepresentation LearningSentence

MultiSpanQA: A Dataset for Multi-Span Question Answering

2022-07-01 · NAACL 2022 7 · Haonan Li, Martin Tomko, Maria Vasardani, Timothy Baldwin

Most existing reading comprehension datasets focus on single-span answers, which can be extracted as a single contiguous span from a given text passage. Multi-span questions, i.e., questions whose answer is a series of m…

Natural QuestionsQuestion AnsweringReading Comprehension

Enhancing classroom teaching with LLMs and RAG

2024-11-07 · Elizabeth A Mullins, Adrian Portillo, Kristalys Ruiz-Rohena, Aritran Piplai

Large Language Models have become a valuable source of information for our daily inquiries. However, after training, its data source quickly becomes out-of-date, making RAG a useful tool for providing even more recent or…

RAG

Few-Shot Question Answering by Pretraining Span Selection

2021-01-02 · ACL 2021 5 · Ori Ram, Yuval Kirstain, Jonathan Berant, Amir Globerson 외

In several question answering benchmarks, pretrained models have reached human parity through fine-tuning on an order of 100,000 annotated questions and answers. We explore the more realistic few-shot setting, where only…

Question Answering