TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction
Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the context of world models. In this work, we show data-driven traffic simulation can be formulated as a world model. We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving, and based on TrafficBots we obtain a world model tailored for the planning module of autonomous vehicles. Existing data-driven traffic simulators are lacking configurability and scalability. To generate configurable behaviors, for each agent we introduce a destination as navigational information, and a time-invariant latent personality that specifies the behavioral style. To improve the scalability, we present a new scheme of positional encoding for angles, allowing all agents to share the same vectorized context and the use of an architecture based on dot-product attention. As a result, we can simulate all traffic participants seen in dense urban scenarios. Experiments on the Waymo open motion dataset show TrafficBots can simulate realistic multi-agent behaviors and achieve good performance on the motion prediction task.
Code (3)
Tasks
Autonomous DrivingAutonomous VehiclesModel-based Reinforcement Learningmotion predictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TrafficBots V1.5: Traffic Simulation via Conditional VAEs and Transformers with Relative Pose Encoding
In this technical report we present TrafficBots V1.5, a baseline method for the closed-loop simulation of traffic agents. TrafficBots V1.5 achieves baseline-level performance and a 3rd place ranking in the Waymo Open Sim…
Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions
Traffic simulation, complementing real-world data with a long-tail distribution, allows for effective evaluation and enhancement of the ability of autonomous vehicles to handle accident-prone scenarios. Simulating such s…
Autonomous VehiclesMotion PlanningEditing Driver Character: Socially-Controllable Behavior Generation for Interactive Traffic Simulation
Traffic simulation plays a crucial role in evaluating and improving autonomous driving planning systems. After being deployed on public roads, autonomous vehicles need to interact with human road participants with differ…
Autonomous DrivingAutonomous VehiclesCollision Avoidance Detour for Multi-Agent Trajectory Forecasting
We present our approach, Collision Avoidance Detour (CAD), which won the 3rd place award in the 2023 Waymo Open Dataset Challenge - Sim Agents, held at the 2023 CVPR Workshop on Autonomous Driving. To satisfy the motion …
Autonomous DrivingCollision Avoidancemotion predictionTrajectory Forecasting+1GAMMA: A General Agent Motion Model for Autonomous Driving
This paper presents GAMMA, a general motion prediction model that enables large-scale real-time simulation and planning for autonomous driving. GAMMA models heterogeneous, interactive traffic agents. They operate under d…
Autonomous DrivingCollision AvoidanceComputational Efficiencymotion prediction+1