Graph Attention with Hierarchies for Multi-hop Question Answering
Multi-hop QA (Question Answering) is the task of finding the answer to a question across multiple documents. In recent years, a number of Deep Learning-based approaches have been proposed to tackle this complex task, as well as a few standard benchmarks to assess models Multi-hop QA capabilities. In this paper, we focus on the well-established HotpotQA benchmark dataset, which requires models to perform answer span extraction as well as support sentence prediction. We present two extensions to the SOTA Graph Neural Network (GNN) based model for HotpotQA, Hierarchical Graph Network (HGN): (i) we complete the original hierarchical structure by introducing new edges between the query and context sentence nodes; (ii) in the graph propagation step, we propose a novel extension to Hierarchical Graph Attention Network GATH (Graph ATtention with Hierarchies) that makes use of the graph hierarchy to update the node representations in a sequential fashion. Experiments on HotpotQA demonstrate the efficiency of the proposed modifications and support our assumptions about the effects of model related variables.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph AttentionGraph Neural NetworkMulti-hop Question AnsweringQuestion AnsweringSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Coarse-grain Fine-grain Coattention Network for Multi-evidence Question Answering
End-to-end neural models have made significant progress in question answering, however recent studies show that these models implicitly assume that the answer and evidence appear close together in a single document. In t…
Question AnsweringIs Graph Structure Necessary for Multi-hop Question Answering?
Recently, attempting to model texts as graph structure and introducing graph neural networks to deal with it has become a trend in many NLP research areas. In this paper, we investigate whether the graph structure is nec…
Graph AttentionMulti-hop Question AnsweringQuestion AnsweringConversational Question Answering over Knowledge Graphs with Transformer and Graph Attention Networks
This paper addresses the task of (complex) conversational question answering over a knowledge graph. For this task, we propose LASAGNE (muLti-task semAntic parSing with trAnsformer and Graph atteNtion nEtworks). It is th…
Conversational Question AnsweringGraph AttentionKnowledge GraphsQuestion Answering+1Hierarchical Modeling for Medical Visual Question Answering with Cross-Attention Fusion
Medical Visual Question Answering (Med-VQA) answers clinical questions using medical images, aiding diagnosis. Designing the MedVQA system holds profound importance in assisting clinical diagnosis and enhancing diagnosti…
DiagnosticMedical Visual Question AnsweringQuestion AnsweringVisual Question Answering+1Co-Stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences
Learning a matching function between two text sequences is a long standing problem in NLP research. This task enables many potential applications such as question answering and paraphrase identification. This paper propo…
Paraphrase IdentificationQuestion Answering