Self-Segregating and Coordinated-Segregating Transformer for Focused Deep Multi-Modular Network for Visual Question Answering
Attention mechanism has gained huge popularity due to its effectiveness in achieving high accuracy in different domains. But attention is opportunistic and is not justified by the content or usability of the content. Transformer like structure creates all/any possible attention(s). We define segregating strategies that can prioritize the contents for the applications for enhancement of performance. We defined two strategies: Self-Segregating Transformer (SST) and Coordinated-Segregating Transformer (CST) and used it to solve visual question answering application. Self-segregation strategy for attention contributes in better understanding and filtering the information that can be most helpful for answering the question and create diversity of visual-reasoning for attention. This work can easily be used in many other applications that involve repetition and multiple frames of features and would reduce the commonality of the attentions to a great extent. Visual Question Answering (VQA) requires understanding and coordination of both images and textual interpretations. Experiments demonstrate that segregation strategies for cascaded multi-head transformer attention outperforms many previous works and achieved considerable improvement for VQA-v2 dataset benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)Visual ReasoningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Stationary distribution of a 2-island 2-allele Wright-Fisher diffusion model with slow mutation and migration rates
The stationary distribution of the diffusion limit of the 2-island, 2-allele Wright-Fisher with small but otherwise arbitrary mutation and migration rates is investigated. Following a method developed by Burden and Tang …
Fundamental limits on the accuracy of demographic inference based on the sample frequency spectrum
The sample frequency spectrum (SFS) of DNA sequences from a collection of individuals is a summary statistic which is commonly used for parametric inference in population genetics. Despite the popularity of SFS-based inf…
One-Shot learning based classification for segregation of plastic waste
The problem of segregating recyclable waste is fairly daunting for many countries. This article presents an approach for image based classification of plastic waste using one-shot learning techniques. The proposed approa…
General ClassificationOne-Shot LearningTripletIncome Inequality and Intergenerational Mobility in India
Using three rounds of NSS datasets, the present paper attempts to understand the relationship between income inequality and intergenerational income mobility (IGIM) by segregating generations into social and income class…
This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagation
Current machine learning models have shown high efficiency in solving a wide variety of real-world problems. However, their black box character poses a major challenge for the understanding and traceability of the underl…
Decision Making