Dynamic Coattention Networks For Question Answering
Several deep learning models have been proposed for question answering. However, due to their single-pass nature, they have no way to recover from local maxima corresponding to incorrect answers. To address this problem, we introduce the Dynamic Coattention Network (DCN) for question answering. The DCN first fuses co-dependent representations of the question and the document in order to focus on relevant parts of both. Then a dynamic pointing decoder iterates over potential answer spans. This iterative procedure enables the model to recover from initial local maxima corresponding to incorrect answers. On the Stanford question answering dataset, a single DCN model improves the previous state of the art from 71.0% F1 to 75.9%, while a DCN ensemble obtains 80.4% F1.
Code (6)
Tasks
DecoderQuestion AnsweringSimilar Papers 제목 키워드 기반
DCN+: Mixed Objective and Deep Residual Coattention for Question Answering
Traditional models for question answering optimize using cross entropy loss, which encourages exact answers at the cost of penalizing nearby or overlapping answers that are sometimes equally accurate. We propose a mixed …
Question AnsweringCoarse-grain Fine-grain Coattention Network for Multi-evidence Question Answering
End-to-end neural models have made significant progress in question answering, however recent studies show that these models implicitly assume that the answer and evidence appear close together in a single document. In t…
Question AnsweringImproving Passage Re-Ranking with Word N-Gram Aware Coattention Encoder
In text matching applications, coattentions have proved to be highly effective attention mechanisms. Coattention enables the learning to attend based on computing word level affinity scores between two texts. In this pap…
Passage RankingPassage Re-RankingRe-RankingText MatchingSeeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings
Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially co…
Common Sense ReasoningKnowledge Graph EmbeddingsQuestion AnsweringRetrieval+3CAESAR: Context Awareness Enabled Summary-Attentive Reader
Comprehending meaning from natural language is a primary objective of Natural Language Processing (NLP), and text comprehension is the cornerstone for achieving this objective upon which all other problems like chat bots…
Reading ComprehensionTranslation