paper-with-me

Papers

DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving

2024-08-01

This paper presented DriveArena, the first high-fidelity closed-loop simulation system designed for driving agents navigating in real scenarios. DriveArena features a flexible, modular architecture, allowing for the seamless interchange of its core components: Traffic Manager, a traffic simulator capable of generating realistic traffic flow on any worldwide street map, and World Dreamer, a high-fidelity conditional generative model with infinite autoregression. This powerful synergy empowers any driving agent capable of processing real-world images to navigate in DriveArena's simulated environment. The agent perceives its surroundings through images generated by World Dreamer and output trajectories. These trajectories are fed into Traffic Manager, achieving realistic interactions with other vehicles and producing a new scene layout. Finally, the latest scene layout is relayed back into World Dreamer, perpetuating the simulation cycle. This iterative process fosters closed-loop exploration within a highly realistic environment, providing a valuable platform for developing and evaluating driving agents across diverse and challenging scenarios. DriveArena signifies a substantial leap forward in leveraging generative image data for the driving simulation platform, opening insights for closed-loop autonomous driving. Code will be available soon on GitHub: https://github.com/PJLab-ADG/DriveArena

📄 PDF Abstract BibTeX arXiv:2408.00415

Code (1)

PJLab-ADG/DriveArena jax

Similar Papers 제목 키워드 기반

DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes

2024-09-06 · Jianbiao Mei, Xuemeng Yang, Licheng Wen, Tao Hu 외

Recent advances in diffusion models have improved controllable streetscape generation and supported downstream perception and planning tasks. However, challenges remain in accurately modeling driving scenes and generatin…

Video Generation

Point as Skeleton: Accumulated Point Cloud Enhanced Autoregressive Generation for Closed-Loop Autonomous Driving Simulation

2026-07-07 · Songbur Wong, Xiaosong Jia, Junqi You, Bo Zhang 외 arxiv

Evaluating end-to-end autonomous driving (E2E-AD) remains challenging, as existing driving simulation methods often trade off closed-loop interactivity (e.g., CARLA) and real-world visual fidelity (e.g., nuScenes). We pr…

Autonomous DrivingVideo Generation

RIFT: Closed-Loop RL Fine-Tuning for Realistic and Controllable Traffic Simulation

2025-05-06 · Keyu Chen, Wenchao Sun, Hao Cheng, Sifa Zheng

Achieving both realism and controllability in interactive closed-loop traffic simulation remains a key challenge in autonomous driving. Data-driven simulation methods reproduce realistic trajectories but suffer from cova…

Autonomous DrivingImitation Learning

Closed-Loop Hybrid Digital Twin Platform for Connected and Automated Vehicle Validation

2026-05-19 · Kanglong Quan, Zhebing Xia, Linfeng Jiang, Hao Yu 외 arxiv

Comprehensive and efficient validation of connected and automated vehicles (CAVs) is critical prior to real-world deployment. While simulation-based testing offers scalability, existing approaches often lack seamless int…

Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving

2025-08-04 · Tianyuan Zhang, Ting Jin, Lu Wang, Jiangfan Liu 외 arxiv

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to op…

Autonomous Driving