paper-with-me

홈 › Papers

SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic

2024-03-26 · Kashyap Chitta, Daniel Dauner, Andreas Geiger

SLEDGE is the first generative simulator for vehicle motion planning trained on real-world driving logs. Its core component is a learned model that is able to generate agent bounding boxes and lane graphs. The model's outputs serve as an initial state for rule-based traffic simulation. The unique properties of the entities to be generated for SLEDGE, such as their connectivity and variable count per scene, render the naive application of most modern generative models to this task non-trivial. Therefore, together with a systematic study of existing lane graph representations, we introduce a novel raster-to-vector autoencoder. It encodes agents and the lane graph into distinct channels in a rasterized latent map. This facilitates both lane-conditioned agent generation and combined generation of lanes and agents with a Diffusion Transformer. Using generated entities in SLEDGE enables greater control over the simulation, e.g. upsampling turns or increasing traffic density. Further, SLEDGE can support 500m long routes, a capability not found in existing data-driven simulators like nuPlan. It presents new challenges for planning algorithms, evidenced by failure rates of over 40% for PDM, the winner of the 2023 nuPlan challenge, when tested on hard routes and dense traffic generated by our model. Compared to nuPlan, SLEDGE requires 500$\times$ less storage to set up (<4 GB), making it a more accessible option and helping with democratizing future research in this field.

📄 PDF Abstract BibTeX arXiv:2403.17933

Code (1)

autonomousvision/sledge 공식 구현

Tasks

Motion Planning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Attention 설명 없음

Similar Papers 제목 키워드 기반

Finetuning Generative Trajectory Model with Reinforcement Learning from Human Feedback

2025-03-13 · Derun Li, Jianwei Ren, Yue Wang, Xin Wen 외

Generating human-like and adaptive trajectories is essential for autonomous driving in dynamic environments. While generative models have shown promise in synthesizing feasible trajectories, they often fail to capture th…

Autonomous DrivingImitation LearningMotion PlanningNavSim

SLeDGe: Semi-Supervised Learning on Data Streams with Graph Structure Learning

2026-06-19 · Heechan Moon, Kijung Shin arxiv

Semi-supervised learning (SSL) on data streams is challenging due to the continuous evolution of high-volume data and the scarcity of labels. Existing methods are limited in leveraging the intrinsic relationships among s…

Graph structure learning

Emergent Road Rules In Multi-Agent Driving Environments

2020-11-21 · ICLR 2021 1 · Avik Pal, Jonah Philion, Yuan-Hong Liao, Sanja Fidler

For autonomous vehicles to safely share the road with human drivers, autonomous vehicles must abide by specific "road rules" that human drivers have agreed to follow. "Road rules" include rules that drivers are required …

Autonomous Vehicles

Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments

2025-03-28 · CVPR 2025 1 · Luke Rowe, Roger Girgis, Anthony Gosselin, Liam Paull 외

We introduce Scenario Dreamer, a fully data-driven generative simulator for autonomous vehicle planning that generates both the initial traffic scene - comprising a lane graph and agent bounding boxes - and closed-loop a…

GPUScene Generation

ScenicRules: An Autonomous Driving Benchmark with Multi-Objective Specifications and Abstract Scenarios

2026-02-17 · Kevin Kai-Chun Chang, Ekin Beyazit, Alberto Sangiovanni-Vincentelli, Tichakorn Wongpiromsarn 외 arxiv

Developing autonomous driving systems for complex traffic environments requires balancing multiple objectives, such as avoiding collisions, obeying traffic rules, and making efficient progress. In many situations, these …

Autonomous VehiclesAutonomous Driving