paper-with-me

홈 › Papers

RoadSceneVQA: Benchmarking Visual Question Answering in Roadside Perception Systems for Intelligent Transportation System

2025-11-23 · Runwei Guan, Rongsheng Hu, Shangshu Chen, Ningyuan Xiao, Xue Xia, Jiayang Liu, Beibei Chen, Ziren Tang, Ningwei Ouyang, Shaofeng Liang, Yuxuan Fan, Wanjie Sun, Yutao Yue arxiv

Current roadside perception systems mainly focus on instance-level perception, which fall short in enabling interaction via natural language and reasoning about traffic behaviors in context. To bridge this gap, we introduce RoadSceneVQA, a large-scale and richly annotated visual question answering (VQA) dataset specifically tailored for roadside scenarios. The dataset comprises 34,736 diverse QA pairs collected under varying weather, illumination, and traffic conditions, targeting not only object attributes but also the intent, legality, and interaction patterns of traffic participants. RoadSceneVQA challenges models to perform both explicit recognition and implicit commonsense reasoning, grounded in real-world traffic rules and contextual dependencies. To fully exploit the reasoning potential of Multi-modal Large Language Models (MLLMs), we further propose CogniAnchor Fusion (CAF), a vision-language fusion module inspired by human-like scene anchoring mechanisms. Moreover, we propose the Assisted Decoupled Chain-of-Thought (AD-CoT) to enhance the reasoned thinking via CoT prompting and multi-task learning. Based on the above, we propose the baseline model RoadMind. Experiments on RoadSceneVQA and CODA-LM benchmark show that the pipeline consistently improves both reasoning accuracy and computational efficiency, allowing the MLLM to achieve state-of-the-art performance in structural traffic perception and reasoning tasks.

📄 PDF Abstract BibTeX arXiv:2511.18286

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Question AnsweringComputational EfficiencyMulti-Task Learning

Similar Papers 제목 키워드 기반

Latent Variable Models for Visual Question Answering

2021-01-16 · Zixu Wang, Yishu Miao, Lucia Specia

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are u…

BenchmarkingQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility?

2022-10-26 · Yang Trista Cao, Kyle Seelman, Kyungjun Lee, Hal Daumé III

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visua…

BenchmarkingQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Chart Question Answering from Real-World Analytical Narratives

2025-07-02 · Maeve Hutchinson, Radu Jianu, Aidan Slingsby, Jo Wood 외 arxiv

We present a new dataset for chart question answering (CQA) constructed from visualization notebooks. The dataset features real-world, multi-view charts paired with natural language questions grounded in analytical narra…

Chart Question Answering

Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089

2023-11-06 · International Semantic Web Conference 2023 11 · Sergios-Anestis Kefalidis, Dharmen Punjani, Eleni Tsalapati, Konstantinos Plas 외

We present the dataset GeoQuestions1089 for benchmarking geospatial question answering engines. GeoQuestions1089 is the largest such dataset available presently and it contains 1089 questions, their corresponding GeoSPA…

BenchmarkingKnowledge Base Question AnsweringQuestion Answering

Learning to Disambiguate by Asking Discriminative Questions

2017-08-09 · ICCV 2017 10 · Yining Li, Chen Huang, Xiaoou Tang, Chen-Change Loy

The ability to ask questions is a powerful tool to gather information in order to learn about the world and resolve ambiguities. In this paper, we explore a novel problem of generating discriminative questions to help di…

BenchmarkingImage CaptioningQuestion AnsweringQuestion Generation+3