Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection
The Document-based Visual Question Answering competition addresses the automatic detection of parent-child relationships between elements in multi-page documents. The goal is to identify the document elements that answer a specific question posed in natural language. This paper describes the PoliTo's approach to addressing this task, in particular, our best solution explores a text-only approach, leveraging an ad hoc sampling strategy. Specifically, our approach leverages the Masked Language Modeling technique to fine-tune a BERT model, focusing on sentences containing sensitive keywords that also occur in the questions, such as references to tables or images. Thanks to the effectiveness of this approach, we are able to achieve high performance compared to baselines, demonstrating how our solution contributes positively to this task.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingMasked Language ModelingQuestion AnsweringSentenceVisual Question AnsweringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Scientific Visual Question Answering through Multimodal Reasoning and Ensemble Modeling
Technical reports and articles often contain valuable information in the form of semi-structured data like charts, and figures. Interpreting these and using the information from them is essential for downstream tasks suc…
ArticlesMultimodal ReasoningQuestion AnsweringVisual Question AnsweringMIMOQA: Multimodal Input Multimodal Output Question Answering
Multimodal research has picked up significantly in the space of question answering with the task being extended to visual question answering, charts question answering as well as multimodal input question answering. Howe…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)BERT-VQA: Visual Question Answering on Plots
Visual question answering has been an exciting challenge in the field of natural language understanding, as it requires deep learning models to exchange information from both vision and language domains. In this project,…
Natural Language UnderstandingVisual Question AnsweringVLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge
There has been a growing interest in solving Visual Question Answering (VQA) tasks that require the model to reason beyond the content present in the image. In this work, we focus on questions that require commonsense re…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Exploring Neural Net Augmentation to BERT for Question Answering on SQUAD 2.0
Enhancing machine capabilities to answer questions has been a topic of considerable focus in recent years of NLP research. Language models like Embeddings from Language Models (ELMo)[1] and Bidirectional Encoder Represen…
Language ModelingLanguage ModellingQuestion Answering