FigureNet: A Deep Learning model for Question-Answering on Scientific Plots
Deep Learning has managed to push boundaries in a wide variety of tasks. One area of interest is to tackle problems in reasoning and understanding, with an aim to emulate human intelligence. In this work, we describe a deep learning model that addresses the reasoning task of question-answering on categorical plots. We introduce a novel architecture FigureNet, that learns to identify various plot elements, quantify the represented values and determine a relative ordering of these statistical values. We test our model on the FigureQA dataset which provides images and accompanying questions for scientific plots like bar graphs and pie charts, augmented with rich annotations. Our approach outperforms the state-of-the-art Relation Networks baseline by approximately $7\%$ on this dataset, with a training time that is over an order of magnitude lesser.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningQuestion AnsweringSimilar Papers 제목 키워드 기반
SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers
Seeking answers to questions within long scientific research articles is a crucial area of study that aids readers in quickly addressing their inquiries. However, existing question-answering (QA) datasets based on scient…
ArticlesQuestion AnsweringVisual Question Answering (VQA)PlotQA: Reasoning over Scientific Plots
Existing synthetic datasets (FigureQA, DVQA) for reasoning over plots do not contain variability in data labels, real-valued data, or complex reasoning questions. Consequently, proposed models for these datasets do not f…
Chart Question AnsweringQuestion AnsweringVisual Question Answering (VQA)BERT-VQA: Visual Question Answering on Plots
Visual question answering has been an exciting challenge in the field of natural language understanding, as it requires deep learning models to exchange information from both vision and language domains. In this project,…
Natural Language UnderstandingVisual Question AnsweringAn Interactive Web-Interface for Visualizing the Inner Workings of the Question Answering LSTM
We present a visualisation tool which aims to illuminate the inner workings of an LSTM model for question answering. It plots heatmaps of neurons{'} firings and allows a user to check the dependency between neurons and m…
Feature EngineeringMachine TranslationQuestion AnsweringQuery-driven Document-level Scientific Evidence Extraction from Biomedical Studies
Extracting scientific evidence from biomedical studies for clinical research questions (e.g., Does stem cell transplantation improve quality of life in patients with medically refractory Crohn's disease compared to place…
RetrievalRetrieval-augmented Generation