paper-with-me

Papers

A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models

2026-06-27 · Nuo Chen, Lulin Liu, Zihao Li, Ziyao Zeng, Zihao Zhu, Wenyan Cong, Junyuan Hong, Yunhao Yang, Zhengzhong Tu, Yan Wang, Boris Ivanovic, Marco Pavone, Zhangyang Wang, Yang Zhou, Zhiwen Fan arxiv

Generative world models hold immense promise as scalable simulators for autonomous systems, particularly for synthesizing rare but safety-critical multi-agent interactions, such as vehicle collisions. However, current evaluation paradigms index heavily on visual fidelity and semantic alignment, leaving a critical blind spot: they cannot reliably quantify whether generated dynamics actually obey the fundamental physical laws required for reliable simulation. Assessing this physical plausibility is inherently difficult due to a lack of physical metrics and the challenge of extracting metric-scale kinematics from uncalibrated video rollouts. To bridge this gap, we introduce CrashTwin, a physics-grounded evaluation framework designed to stress-test the physical trustworthiness of world models. CrashTwin couples a diverse dataset of multi-agent collision scenarios, comprising 25K controllable synthetic and 12K in-the-wild real-world collision sequences with a novel calibration-free reconstruction pipeline, enabling the recovery of 3D physical attributes directly from world model rollouts. We propose a diagnostic suite that systematically evaluates three dimensions: spatio-temporal consistency, momentum and kinetic energy conservation, and world-dynamics integrity. Extensive benchmarking of state-of-the-art models reveals a crucial insight: high perceptual quality frequently masks severe physical violations during complex interactions. By quantitatively exposing these failure modes, CrashTwin provides a vital diagnostic tool for developing physically grounded world models capable of reliable real-world simulation.

📄 PDF Abstract BibTeX arXiv:2606.28757

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SceneFactory: GPU-Accelerated Multi-Agent Driving Simulation with Physics-Based Vehicle Dynamics

2026-05-08 · Yicheng Zhu, Yang Chen, Tao Li, Zilin Bian arxiv

Autonomous-driving simulators typically trade physical fidelity for scalable parallelism. Physics-based platforms such as CARLA and MetaDrive provide articulated vehicle dynamics and contact, but their non-vectorized int…

Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learning

2026-03-11 · Yuto Shibata, Kashu Yamazaki, Lalit Jayanti, Yoshimitsu Aoki 외 arxiv

Humanoid robotics has strong potential to transform daily service and caregiving applications. Although recent advances in general motion tracking within physics engines (GMT) have enabled virtual characters and humanoid…

Multi-agent Reinforcement Learning

Grounding Social Perception in Intuitive Physics

2026-03-28 · Lance Ying, Aydan Y. Huang, Aviv Netanyahu, Andrei Barbu 외 arxiv

People infer rich social information from others' actions. These inferences are often constrained by the physical world: what agents can do, what obstacles permit, and how the physical actions of agents causally change a…

ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction

2026-05-14 · Hongyu Wang, Jingquan Wang, Bocheng Zou, Radu Serban 외 arxiv

Video-based world models generate visually plausible rollouts, but since they infer dynamics in latent states, they enforce no explicit physical constraints: contacts drift, shapes distort, and motion loses consistency. …

Code Generation

Multi-turn Physics-informed Vision-language Model for Physics-grounded Anomaly Detection

2026-03-16 · Yao Gu, Xiaohao Xu, Yingna Wu arxiv

Vision-Language Models (VLMs) demonstrate strong general-purpose reasoning but remain limited in physics-grounded anomaly detection, where causal understanding of dynamics is essential. Existing VLMs, trained predominant…

Anomaly Detection