ReasonDrive: Efficient Visual Question Answering for Autonomous Vehicles with Reasoning-Enhanced Small Vision-Language Models
Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM performance on driving decision tasks. Using GPT-4o, we generate structured reasoning chains for driving scenarios from the DriveLM benchmark with category-specific prompting strategies. We compare reasoning-based fine-tuning, answer-only fine-tuning, and baseline instruction-tuned models across multiple small VLM families (Llama 3.2, Llava 1.5, and Qwen 2.5VL). Our results demonstrate that reasoning-based fine-tuning consistently outperforms alternatives, with Llama3.2-11B-reason achieving the highest performance. Models fine-tuned with reasoning show substantial improvements in accuracy and text generation quality, suggesting explicit reasoning enhances internal representations for driving decisions. These findings highlight the importance of transparent decision processes in safety-critical domains and offer a promising direction for developing more interpretable autonomous driving systems.
Code (1)
Tasks
Autonomous DrivingAutonomous VehiclesQuestion AnsweringText GenerationVisual Question AnsweringSimilar Papers 제목 키워드 기반
Explaining Autonomous Driving Actions with Visual Question Answering
The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving te…
Autonomous DrivingAutonomous VehiclesDecision MakingQuestion Answering+3LAVQA: A Latency-Aware Visual Question Answering Framework for Shared Autonomy in Self-Driving Vehicles
When uncertainty is high, self-driving vehicles may halt for safety and benefit from the access to remote human operators who can provide high-level guidance. This paradigm, known as {shared autonomy}, enables autonomous…
Visual Question AnsweringEfficient Visual Question Answering Pipeline for Autonomous Driving via Scene Region Compression
Autonomous driving increasingly relies on Visual Question Answering (VQA) to enable vehicles to understand complex surroundings by analyzing visual inputs and textual queries. Currently, a paramount concern for VQA in th…
Visual Question AnsweringVideo Question AnsweringComputational EfficiencyAutonomous DrivingOptimizing Visual Question Answering Models for Driving: Bridging the Gap Between Human and Machine Attention Patterns
Visual Question Answering (VQA) models play a critical role in enhancing the perception capabilities of autonomous driving systems by allowing vehicles to analyze visual inputs alongside textual queries, fostering natura…
Autonomous DrivingQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)Modeling Perception Errors towards Robust Decision Making in Autonomous Vehicles
Sensing and Perception (S&P) is a crucial component of an autonomous system (such as a robot), especially when deployed in highly dynamic environments where it is required to react to unexpected situations. This is parti…
Autonomous VehiclesDecision Making