paper-with-me

Papers

Language Conditioned Traffic Generation

2023-07-16 · Shuhan Tan, Boris Ivanovic, Xinshuo Weng, Marco Pavone, Philipp Kraehenbuehl

Simulation forms the backbone of modern self-driving development. Simulators help develop, test, and improve driving systems without putting humans, vehicles, or their environment at risk. However, simulators face a major challenge: They rely on realistic, scalable, yet interesting content. While recent advances in rendering and scene reconstruction make great strides in creating static scene assets, modeling their layout, dynamics, and behaviors remains challenging. In this work, we turn to language as a source of supervision for dynamic traffic scene generation. Our model, LCTGen, combines a large language model with a transformer-based decoder architecture that selects likely map locations from a dataset of maps, and produces an initial traffic distribution, as well as the dynamics of each vehicle. LCTGen outperforms prior work in both unconditional and conditional traffic scene generation in terms of realism and fidelity. Code and video will be available at https://ariostgx.github.io/lctgen.

📄 PDF Abstract BibTeX arXiv:2307.07947

Code (1)

Ariostgx/lctgen 공식 구현 pytorch

Tasks

DecoderLanguage ModelingLanguage ModellingLarge Language ModelScene Generation

Similar Papers 제목 키워드 기반

Scenario Diffusion: Controllable Driving Scenario Generation With Diffusion

2023-11-05 · NeurIPS 2023 11

Automated creation of synthetic traffic scenarios is a key part of validating the safety of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating tra…

Autonomous Vehiclesobject-detectionObject Detection

LANGTRAJ: Diffusion Model and Dataset for Language-Conditioned Trajectory Simulation

2025-04-15 · Wei-Jer Chang, Wei Zhan, Masayoshi Tomizuka, Manmohan Chandraker 외

Evaluating autonomous vehicles with controllability enables scalable testing in counterfactual or structured settings, enhancing both efficiency and safety. We introduce LangTraj, a language-conditioned scene-diffusion m…

Autonomous Vehiclescounterfactual

Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation

2026-06-25 · Shubham Vaijanath Phoolari, Aleyna Kara, Christoph Lauer, Steven Peters arxiv

Closed-loop traffic simulation remains challenging because it must generate interactive multi-agent behaviors that are scene-consistent and controllable throughout rollout. Prior diffusion-based approaches achieve strong…

A Road-Conditioned Traffic Movie Prediction Network with Spatiotemporal and Structure-Consistent Learning

2026-05-27 · Joshua Kofi Asamoah, Blessing Agyei Kyem, Armstrong Aboah arxiv

City-wide traffic forecasting is important for congestion management, route guidance, and intelligent transportation systems, but accurate prediction remains challenging when future traffic must be generated as spatial m…

Image Reconstruction

Generative Scenario Rollouts for End-to-End Autonomous Driving

2026-01-16 · Rajeev Yasarla, Deepti Hegde, Shizhong Han, Hsin-Pai Cheng 외 arxiv

Vision-Language-Action (VLA) models are emerging as highly effective planning models for end-to-end autonomous driving systems. However, current works mostly rely on imitation learning from sparse trajectory annotations …

Reinforcement LearningAutonomous Driving