iVQA: Inverse Visual Question Answering

2017-10-10 · CVPR 2018 6 · Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair. Since the answers are less informative than the questions, and the questions have less learnable bias, an iVQA model needs to better understand the image to be successful than a VQA model. We pose question generation as a multi-modal dynamic inference process and propose an iVQA model that can gradually adjust its focus of attention guided by both a partially generated question and the answer. For evaluation, apart from existing linguistic metrics, we propose a new ranking metric. This metric compares the ground truth question's rank among a list of distractors, which allows the drawbacks of different algorithms and sources of error to be studied. Experimental results show that our model can generate diverse, grammatically correct and content correlated questions that match the given answer.

📄 PDF Abstract BibTeX arXiv:1710.03370

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering Question Generation Question-Generation Visual Question Answering Visual Question Answering (VQA)

Inverse Visual Question Answering: A New Benchmark and VQA Diagnosis Tool

2018-03-16 · Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang 외

In recent years, visual question answering (VQA) has become topical. The premise of VQA's significance as a benchmark in AI, is that both the image and textual question need to be well understood and mutually grounded in…

Question Answering Reinforcement Learning Visual Question Answering Visual Question Answering (VQA)

Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation

2026-07-07 · Shenxi Liu, Kan Li, Mingyang Zhao, Yuhang Tian 외 arxiv

Following the CMIVQA, MMI-VQA, and M4IVQA challenges in NLPCC 2023--2025, we introduce the Difficulty-Aware Medical Instructional Video Question Answering (DA-MIVQA) shared task for NLPCC 2026. DA-MIVQA extends previous …

Video Question Answering Visual Grounding

ViVQA: Vietnamese Visual Question Answering

2021-11-01 · PACLIC 2021 11 · Khanh Quoc Tran, An Trong Nguyen, An Tran-Hoai Le, Kiet Van Nguyen

Question Answering Vietnamese Visual Question Answering Visual Question Answering Visual Question Answering (VQA)

WikiVQABench: A Knowledge-Grounded Visual Question Answering Benchmark from Wikipedia and Wikidata

2026-05-20 · Basel Shbita, Pengyuan Li, Anna Lisa Gentile arxiv

Visual Question Answering (VQA) benchmarks have largely emphasized perception-based tasks that can be solved from visual content alone. In contrast, many real-world scenarios require external knowledge that is not direct…

Visual Question Answering

AutoViVQA: A Large-Scale Automatically Constructed Dataset for Vietnamese Visual Question Answering

2026-03-10 · Nguyen Anh Tuong, Phan Ba Duc, Nguyen Trung Quoc, Tran Dac Thinh 외 arxiv

Visual Question Answering (VQA) is a fundamental multimodal task that requires models to jointly understand visual and textual information. Early VQA systems relied heavily on language biases, motivating subsequent work …

Visual Question Answering Representation Learning Machine Translation Image Captioning