paper-with-me

Papers

CAViAR: A Causal Video Dataset for Fine-Grained Accident Reasoning in Real-World Scenarios

2026-08-19 · Sparsh Garg, Yi-Wen Chen, Vijay Kumar B G, Abhishek Aich arxiv

While modern autonomous driving systems excel at perception tasks such as object detection and trajectory prediction, they lack the high-level causal reasoning required to interpret traffic accidents. In particular, determining responsibility, such as identifying who is at fault and which traffic rule was violated, remains largely unexplored in current benchmarks. To this end, we introduce CAViAR (Causal Accident Video and Incident Analysis Repository), a human-annotated dashcam benchmark comprising 2,249 real-world accident videos collected from CarCrashDataset (CCD) and Nexar. Each video is annotated with structured labels spanning environmental conditions, accident type, causal explanation, apparent At-Fault Agent, affected agent, and apparent rule-violation category. We benchmark state-of-the-art vision-language models (VLMs), including Cosmos-Reason2, Qwen3-VL, and InternVL3. Once class imbalance is accounted for with majority/random baselines and balanced metrics, perceptual competence is uneven--lighting is nearly solved, whereas weather and road-condition accuracy fall at or below the majority-class baseline---and all models degrade sharply on accident type and responsibility reasoning. Overall, CAViAR exposes a practical Perception--Reasoning Gap: current VLMs may recognize salient context, but do not reliably map visible agent actions to annotated rule-relevant responsibility categories in safety-critical driving scenarios. Code, annotation schema, prompts, and evaluation scripts are available at: https://github.com/nec-labs-ma/CAViAR

📄 PDF Abstract BibTeX arXiv:2608.19380

Code (0)

등록된 구현이 없습니다.

Tasks

Trajectory PredictionAutonomous DrivingObject Detection

Similar Papers 제목 키워드 기반

CAVIAR: Categorical-Variable Embeddings for Accurate and Robust Inference

2024-04-07 · Anirban Mukherjee, Hannah Hanwen Chang

Social science research often hinges on the relationship between categorical variables and outcomes. We introduce CAVIAR, a novel method for embedding categorical variables that assume values in a high-dimensional ambien…

Causal InferenceDimensionality ReductionVariable Selection

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

2025-05-02 · Jen-Hao Cheng, Vivian Wang, Huayu Wang, Huapeng Zhou 외

Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models. Existing methods either compress video tokens to reduce temporal resolution,…

Dense CaptioningHighlight DetectionVideo SegmentationVideo Semantic Segmentation+1

Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA

2026-06-08 · Zhou Du, Hamid Krim, Xiao Wu, Zhaoquan Yuan 외 arxiv

Recent advances in video multimodal models have significantly improved VideoQA performance. However, these systems often rely on spurious statistical correlations rather than answer-relevant causal evidence, resulting in…

Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset

2026-07-11 · Zhiyan Zhang, Peipei Song, Jinpeng Hu, Jingyang Jia 외 arxiv

Video emotion analysis is typically framed as a static classification problem, treating each clip as an independent labeled unit. However, such a formulation overlooks a key psychological fact: emotions change as a resul…

Emotion Classification

Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models

2023-10-09 · Guangzhi Sun, Wenyi Yu, Changli Tang, Xianzhao Chen 외

Audio-visual large language models (LLM) have drawn significant attention, yet the fine-grained combination of both input streams is rather under-explored, which is challenging but necessary for LLMs to understand genera…

Question AnsweringVideo Question Answering