Phrase-Indexed Question Answering: A New Challenge for Scalable Document Comprehension
We formalize a new modular variant of current question answering tasks by enforcing complete independence of the document encoder from the question encoder. This formulation addresses a key challenge in machine comprehension by requiring a standalone representation of the document discourse. It additionally leads to a significant scalability advantage since the encoding of the answer candidate phrases in the document can be pre-computed and indexed offline for efficient retrieval. We experiment with baseline models for the new task, which achieve a reasonable accuracy but significantly underperform unconstrained QA models. We invite the QA research community to engage in Phrase-Indexed Question Answering (PIQA, pika) for closing the gap. The leaderboard is at: nlp.cs.washington.edu/piqa
Code (1)
Tasks
Question AnsweringReading ComprehensionRetrievalSimilar Papers 제목 키워드 기반
EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System
State-of-the-art extractive question answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Th…
Extractive Question-AnsweringGPUNatural Language UnderstandingOpen-Domain Question Answering+1Learning Dense Representations of Phrases at Scale
Open-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019). However, current phrase retrieval models heavily …
Open-Domain Question AnsweringQuestion AnsweringQuestion GenerationReading Comprehension+3Bridging the Training-Inference Gap for Dense Phrase Retrieval
Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that traini…
Open-Domain Question AnsweringPassage RetrievalQuestion AnsweringRetrievalExploring the Role of Logically Related Non-Question Phrases for Answering Why-Questions
In this paper, we show that certain phrases although not present in a given question/query, play a very important role in answering the question. Exploring the role of such phrases in answering questions not only reduces…
Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering
Multi-hop Question Answering (QA) necessitates complex reasoning by integrating multiple pieces of information to resolve intricate questions. However, existing QA systems encounter challenges such as outdated informatio…
Multi-hop Question AnsweringQuestion AnsweringRetrievalRetrieval-augmented Generation