paper-with-me

Papers

Language-Guided Traffic Simulation via Scene-Level Diffusion

2023-06-10 · Ziyuan Zhong, Davis Rempe, Yuxiao Chen, Boris Ivanovic, Yulong Cao, Danfei Xu, Marco Pavone, Baishakhi Ray

Realistic and controllable traffic simulation is a core capability that is necessary to accelerate autonomous vehicle (AV) development. However, current approaches for controlling learning-based traffic models require significant domain expertise and are difficult for practitioners to use. To remedy this, we present CTG++, a scene-level conditional diffusion model that can be guided by language instructions. Developing this requires tackling two challenges: the need for a realistic and controllable traffic model backbone, and an effective method to interface with a traffic model using language. To address these challenges, we first propose a scene-level diffusion model equipped with a spatio-temporal transformer backbone, which generates realistic and controllable traffic. We then harness a large language model (LLM) to convert a user's query into a loss function, guiding the diffusion model towards query-compliant generation. Through comprehensive evaluation, we demonstrate the effectiveness of our proposed method in generating realistic, query-compliant traffic simulations.

📄 PDF Abstract BibTeX arXiv:2306.06344

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model

2025-01-01 · CVPR 2025 1 · Shuhan Tan, John Lambert, Hong Jeon, Sakshum Kulshrestha 외

The goal of traffic simulation is to augment a potentially limited amount of manually-driven miles that is available for testing and validation, with a much larger amount of simulated synthetic miles. The culmination…

Scene Generation

SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout

2024-12-05 · Chiyu Max Jiang, Yijing Bai, Andre Cornman, Christopher Davis 외

Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a…

DenoisingLarge Language ModelScene Generation

Safety-Critical Traffic Simulation with Guided Latent Diffusion Model

2025-05-01 · Mingxing Peng, Ruoyu Yao, Xusen Guo, Yuting Xie 외

Safety-critical traffic simulation plays a crucial role in evaluating autonomous driving systems under rare and challenging scenarios. However, existing approaches often generate unrealistic scenarios due to insufficient…

Autonomous DrivingComputational EfficiencyDenoising

HorizonWeaver: Generalizable Multi-Level Semantic Editing for Driving Scenes

2026-04-06 · Mauricio Soroco, Francesco Pittaluga, Zaid Tasneem, Abhishek Aich 외 arxiv

Ensuring safety in autonomous driving requires scalable generation of realistic, controllable driving scenes beyond what real-world testing provides. Yet existing instruction guided image editors, trained on object-centr…

Autonomous DrivingBEV Segmentation

GraphSCENE: On-Demand Critical Scenario Generation for Autonomous Vehicles in Simulation

2024-10-17 · Efimia Panagiotaki, Georgi Pramatarov, Lars Kunze, Daniele De Martini

Testing and validating Autonomous Vehicle (AV) performance in safety-critical and diverse scenarios is crucial before real-world deployment. However, manually creating such scenarios in simulation remains a significant a…

Autonomous VehiclesGraph Neural Networkvalid