The Forgettable-Watcher Model for Video Question Answering
A number of visual question answering approaches have been proposed recently, aiming at understanding the visual scenes by answering the natural language questions. While the image question answering has drawn significant attention, video question answering is largely unexplored. Video-QA is different from Image-QA since the information and the events are scattered among multiple frames. In order to better utilize the temporal structure of the videos and the phrasal structures of the answers, we propose two mechanisms: the re-watching and the re-reading mechanisms and combine them into the forgettable-watcher model. Then we propose a TGIF-QA dataset for video question answering with the help of automatic question generation. Finally, we evaluate the models on our dataset. The experimental results show the effectiveness of our proposed models.
Code (0)
등록된 구현이 없습니다.
Tasks
modelQuestion AnsweringQuestion GenerationQuestion-GenerationVideo Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
NEWSKVQA: Knowledge-Aware News Video Question Answering
Answering questions in the context of videos can be helpful in video indexing, video retrieval systems, video summarization, learning management systems and surveillance video analysis. Although there exists a large body…
Common Sense ReasoningManagementMultiple-choiceQuestion Answering+6Video Question Answering via Attribute-Augmented Attention Network Learning
Video Question Answering is a challenging problem in visual information retrieval, which provides the answer to the referenced video content according to the question. However, the existing visual question answering appr…
AttributeInformation RetrievalMultiple-choiceQuestion Answering+5Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering
Video question answering has recently received a lot of attention from multimodal video researchers. Most video question answering datasets are usually in the form of multiple-choice. But, the model for the multiple-choi…
Language ModelingLanguage ModellingMultiple-choiceOpen-Ended Question Answering+2Video Question Answering on Screencast Tutorials
This paper presents a new video question answering task on screencast tutorials. We introduce a dataset including question, answer and context triples from the tutorial videos for a software. Unlike other video question …
Question AnsweringVideo Question AnsweringVideo Question Answering with Iterative Video-Text Co-Tokenization
Video question answering is a challenging task that requires understanding jointly the language input, the visual information in individual video frames, as well as the temporal information about the events occurring in …
Question AnsweringVideo Question AnsweringVisual Question Answering (VQA)