paper-with-me

홈 › Papers

SCP: Spatial Causal Prediction in Video

2026-03-04 · Yanguang Zhao, Jie Yang, Shengqiong Wu, Shutong Hu, Hongbo Qiu, Yu Wang, Guijia Zhang, Tan Kai Ze, Hao Fei, Chia-Wen Lin, Mong-Li Lee, Wynne Hsu arxiv

Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however, primarily assess models on visible spatio-temporal understanding, overlooking their ability to infer unseen past or future spatial states. In this work, we introduce Spatial Causal Prediction (SCP), a new task paradigm that challenges models to reason beyond observation and predict spatial causal outcomes. We further construct SCP-Bench, a benchmark comprising 2,500 QA pairs across 1,181 videos spanning diverse viewpoints, scenes, and causal directions, to support systematic evaluation. Through comprehensive experiments on {23} state-of-the-art models, we reveal substantial gaps between human and model performance, limited temporal extrapolation, and weak causal grounding. We further analyze key factors influencing performance and propose perception-enhancement and reasoning-guided strategies toward advancing spatial causal intelligence. The project page is https://guangstrip.github.io/SCP-Bench.

📄 PDF Abstract BibTeX arXiv:2603.03944

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingSpatial Reasoning

Similar Papers 제목 키워드 기반

WAM4D: Fast 4D World Action Model via Spatial Register Tokens

2026-06-12 · Ying Li, Xiaobao Wei, Jiajun Cao, Hao Wang 외 arxiv

World action models (WAMs) have recently shown promise in jointly modeling future observations and executable robot actions. However, most existing WAMs still operate in 2D video or latent spaces, where visually plausibl…

SCR-Graph: Spatial-Causal Relationships based Graph Reasoning Network for Human Action Prediction

2019-11-22 · Bo Chen, Decai Li, Yuqing He, Chunsheng Hua

Technologies to predict human actions are extremely important for applications such as human robot cooperation and autonomous driving. However, a majority of the existing algorithms focus on exploiting visual features of…

Autonomous DrivingGraph AttentionRelational Reasoning

CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Models

2025-06-11 · Aaron Foss, Chloe Evans, Sasha Mitts, Koustuv Sinha 외

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to…

counterfactualDescriptiveQuestion AnsweringVideo Question Answering+1

V-CORE: Temporally Consistent Video Understanding for Video-LLM

2026-01-05 · Zhengjian Kang, Qi Chen, Rui Liu, Kangtong Mo 외 arxiv

Recent Video Large Language Models (Video-LLMs) have shown strong multimodal reasoning capabilities, yet remain challenged by video understanding tasks that require consistent temporal ordering and causal coherence. Many…

Multimodal Reasoning

HCLSM: Hierarchical Causal Latent State Machines for Object-Centric World Modeling

2026-03-31 · Jaber Jaber, Osama Jaber arxiv

World models that predict future states from video remain limited by flat latent representations that entangle objects, ignore causal structure, and collapse temporal dynamics into a single scale. We present HCLSM, a wor…

Graph Neural Network