paper-with-me

홈 › Papers

Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Driving

2026-07-15 · Yuan Gao, Wenting Miao, Mattia Piccinini, Haoyu Wang, Qunying Song, Johannes Betz arxiv

Validating autonomous driving systems requires diverse, regulation-compliant test scenarios. In simulation-based testing, scenarios are defined as executable scripts. Yet automatically generating such scripts from regulatory descriptions remains an open challenge, and existing approaches face fundamental trade-offs. Retrieval-assemble methods achieve reasonable compilation rates but lack scalability, whereas retrieval-based full-script generation suffers from low compilation success rates. We present Chat2Scenic, the first iterative retrieval-augmented framework to generate scenario scripts in Domain Specific Language (DSL). Specifically, Chat2Scenic provides a chatbot interface that supports interactive scenario refinement and integrates Retrieval-augmented Generation (RAG) to ground scenario generation in regulatory knowledge and DSL syntax. Furthermore, we propose an open benchmark for scenario generation comprising 123 scenarios from various regulations, including NHTSA and United Nations Vehicle Regulations, as well as other sources. Extensive evaluation with State-of-the-Art (SOTA) Large Language Models (LLMs) demonstrates that Chat2Scenic achieves 76.42% Compilation Success Rate (CSR) and 58.17% Framework Accuracy (FA), outperforming existing methods (Retrieval Assemble with 30.08% CSR, 11.03% FA and Retrieval full script generation with 16.26% CSR, 10.86% FA). To facilitate future research, we release our code as open source at https://github.com/TUM-AVS/chat2scenic.

📄 PDF Abstract BibTeX arXiv:2607.14387

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

David vs. Goliath: A comparative study of different-sized LLMs for code generation in the domain of automotive scenario generation

2025-10-15 · Philipp Bauerfeind, Amir Salarpour, David Fernandez, Pedram MohajerAnsari 외 arxiv

Scenario simulation is central to testing autonomous driving systems. Scenic, a domain-specific language (DSL) for CARLA, enables precise and reproducible scenarios, but NL-to-Scenic generation with large language models…

Autonomous DrivingCode Generation

Scenic4RL: Programmatic Modeling and Generation of Reinforcement Learning Environments

2021-06-18 · Abdus Salam Azad, Edward Kim, Qiancheng Wu, Kimin Lee 외

The capability of a reinforcement learning (RL) agent heavily depends on the diversity of the learning scenarios generated by the environment. Generation of diverse realistic scenarios is challenging for real-time strate…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Addressing the IEEE AV Test Challenge with Scenic and VerifAI

2021-08-20 · Kesav Viswanadha, Francis Indaheng, Justin Wong, Edward Kim 외

This paper summarizes our formal approach to testing autonomous vehicles (AVs) in simulation for the IEEE AV Test Challenge. We demonstrate a systematic testing framework leveraging our previous work on formally-driven s…

Autonomous VehiclesProbabilistic Programming

Scenic: A Language for Scenario Specification and Scene Generation

2018-09-25 · Daniel J. Fremont, Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue 외

We propose a new probabilistic programming language for the design and analysis of perception systems, especially those based on machine learning. Specifically, we consider the problems of training a perception system to…

Probabilistic ProgrammingScene GenerationSynthetic Data Generation

Scenic: A Language for Scenario Specification and Data Generation

2020-10-13 · Daniel J. Fremont, Edward Kim, Tommaso Dreossi, Shromona Ghosh 외

We propose a new probabilistic programming language for the design and analysis of cyber-physical systems, especially those based on machine learning. Specifically, we consider the problems of training a system to be rob…

Probabilistic ProgrammingSynthetic Data Generation