paper-with-me

Papers

DragTraffic: Interactive and Controllable Traffic Scene Generation for Autonomous Driving

2024-04-19 · Sheng Wang, Ge Sun, Fulong Ma, Tianshuai Hu, Qiang Qin, Yongkang Song, Lei Zhu, Junwei Liang

Evaluating and training autonomous driving systems require diverse and scalable corner cases. However, most existing scene generation methods lack controllability, accuracy, and versatility, resulting in unsatisfactory generation results. Inspired by DragGAN in image generation, we propose DragTraffic, a generalized, interactive, and controllable traffic scene generation framework based on conditional diffusion. DragTraffic enables non-experts to generate a variety of realistic driving scenarios for different types of traffic agents through an adaptive mixture expert architecture. We employ a regression model to provide a general initial solution and a refinement process based on the conditional diffusion model to ensure diversity. User-customized context is introduced through cross-attention to ensure high controllability. Experiments on a real-world driving dataset show that DragTraffic outperforms existing methods in terms of authenticity, diversity, and freedom. Demo videos and code are available at https://chantsss.github.io/Dragtraffic/.

📄 PDF Abstract BibTeX arXiv:2404.12624

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDiversityImage GenerationScene Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation

2026-06-25 · Shubham Vaijanath Phoolari, Aleyna Kara, Christoph Lauer, Steven Peters arxiv

Closed-loop traffic simulation remains challenging because it must generate interactive multi-agent behaviors that are scene-consistent and controllable throughout rollout. Prior diffusion-based approaches achieve strong…

Language-Guided Traffic Simulation via Scene-Level Diffusion

2023-06-10 · Ziyuan Zhong, Davis Rempe, Yuxiao Chen, Boris Ivanovic 외

Realistic and controllable traffic simulation is a core capability that is necessary to accelerate autonomous vehicle (AV) development. However, current approaches for controlling learning-based traffic models require si…

Language ModelingLanguage ModellingLarge Language Model

ChatDyn: Language-Driven Multi-Actor Dynamics Generation in Street Scenes

2024-12-11 · Yuxi Wei, Jingbo Wang, Yuwen Du, Dingju Wang 외

Generating realistic and interactive dynamics of traffic participants according to specific instruction is critical for street scene simulation. However, there is currently a lack of a comprehensive method that generates…

Text2Traffic: A Text-to-Image Generation and Editing Method for Traffic Scenes

2025-11-17 · Feng Lv, Haoxuan Feng, Zilu Zhang, Chunlong Xia 외 arxiv

With the rapid advancement of intelligent transportation systems, text-driven image generation and editing techniques have demonstrated significant potential in providing rich, controllable visual scene data for applicat…

Text-to-Image GenerationAutonomous Driving

SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries

2023-12-31 · Wei-Jer Chang, Francesco Pittaluga, Masayoshi Tomizuka, Wei Zhan 외

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in ter…

Autonomous DrivingDenoising