Tell Me Why: Using Question Answering as Distant Supervision for Answer Justification
For many applications of question answering (QA), being able to explain why a given model chose an answer is critical. However, the lack of labeled data for answer justifications makes learning this difficult and expensive. Here we propose an approach that uses answer ranking as distant supervision for learning how to select informative justifications, where justifications serve as inferential connections between the question and the correct answer while often containing little lexical overlap with either. We propose a neural network architecture for QA that reranks answer justifications as an intermediate (and human-interpretable) step in answer selection. Our approach is informed by a set of features designed to combine both learned representations and explicit features to capture the connection between questions, answers, and answer justifications. We show that with this end-to-end approach we are able to significantly improve upon a strong IR baseline in both justification ranking (+9{\%} rated highly relevant) and answer selection (+6{\%} P@1).
Code (0)
등록된 구현이 없습니다.
Tasks
Answer SelectionInterpretable Machine LearningQuestion AnsweringSimilar Papers 제목 키워드 기반
Denoising Distantly Supervised Open-Domain Question Answering
Distantly supervised open-domain question answering (DS-QA) aims to find answers in collections of unlabeled text. Existing DS-QA models usually retrieve related paragraphs from a large-scale corpus and apply reading com…
DenoisingInformation RetrievalOpen-Domain Question AnsweringQuestion Answering+1Multi-Row, Multi-Span Distant Supervision For Table+Text Question
Question answering (QA) over tables and linked text, also called TextTableQA, has witnessed significant research in recent years, as tables are often found embedded in documents along with related text. HybridQA and OTT-…
Question AnsweringReading ComprehensionDistantly-Supervised Evidence Retrieval Enables Question Answering without Evidence Annotation
Open-domain question answering answers a question based on evidence retrieved from a large corpus. State-of-the-art neural approaches require intermediate evidence annotations for training. However, such intermediate ann…
Open-Domain Question AnsweringQuestion AnsweringRetrievalBEEDS: Large-Scale Biomedical Event Extraction using Distant Supervision and Question Answering
Automatic extraction of event structures from text is a promising way to extract important facts from the evergrowing amount of biomedical literature. We propose BEEDS, a new approach on how to mine event structures from…
Event ExtractionKnowledge Base PopulationQuestion AnsweringDistantly-Supervised Dense Retrieval Enables Open-Domain Question Answering without Evidence Annotation
Open-domain question answering answers a question based on evidence retrieved from a large corpus. State-of-the-art neural approaches require intermediate evidence annotations for training. However, such intermediate ann…
Open-Domain Question AnsweringQuestion AnsweringRetrieval