paper-with-me

Papers

SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving

2020-10-19 · Ming Zhou, Jun Luo, Julian Villella, Yaodong Yang, David Rusu, Jiayu Miao, Weinan Zhang, Montgomery Alban, Iman Fadakar, Zheng Chen, Aurora Chongxi Huang, Ying Wen, Kimia Hassanzadeh, Daniel Graves, Dong Chen, Zhengbang Zhu, Nhat Nguyen, Mohamed Elsayed, Kun Shao, Sanjeevan Ahilan, Baokuan Zhang, Jiannan Wu, Zhengang Fu, Kasra Rezaee, Peyman Yadmellat, Mohsen Rohani, Nicolas Perez Nieves, Yihan Ni, Seyedershad Banijamali, Alexander Cowen Rivers, Zheng Tian, Daniel Palenicek, Haitham Bou Ammar, Hongbo Zhang, Wulong Liu, Jianye Hao, Jun Wang

Multi-agent interaction is a fundamental aspect of autonomous driving in the real world. Despite more than a decade of research and development, the problem of how to competently interact with diverse road users in diverse scenarios remains largely unsolved. Learning methods have much to offer towards solving this problem. But they require a realistic multi-agent simulator that generates diverse and competent driving interactions. To meet this need, we develop a dedicated simulation platform called SMARTS (Scalable Multi-Agent RL Training School). SMARTS supports the training, accumulation, and use of diverse behavior models of road users. These are in turn used to create increasingly more realistic and diverse interactions that enable deeper and broader research on multi-agent interaction. In this paper, we describe the design goals of SMARTS, explain its basic architecture and its key features, and illustrate its use through concrete multi-agent experiments on interactive scenarios. We open-source the SMARTS platform and the associated benchmark tasks and evaluation metrics to encourage and empower research on multi-agent learning for autonomous driving. Our code is available at https://github.com/huawei-noah/SMARTS.

📄 PDF Abstract BibTeX arXiv:2010.09776

Code (5)

huawei-noah/SMARTS 공식 구현 tf
Dikshuy/SMARTS-lite tf
Duckkkky/smarts tf
mcederle99/MAD4QN-PS
yuant95/SMARTS_VCR

Tasks

Autonomous DrivingMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

SmartSnap: Proactive Evidence Seeking for Self-Verifying Agents

2025-12-26 · Shaofei Cai, Yulei Qin, Haojia Lin, Zihan Xu 외 arxiv

Agentic reinforcement learning (RL) holds great promise for the development of autonomous agents under complex GUI tasks, but its scalability remains severely hampered by the verification of task completion. Existing tas…

Reinforcement Learning

LangSAT: A Novel Framework Combining NLP and Reinforcement Learning for SAT Solving

2025-12-04 · Muyu Pan, Matthew Walter, Dheeraj Kodakandla, Mahfuza Farooque arxiv

Our work presents a novel reinforcement learning (RL) based framework to optimize heuristic selection within the conflict-driven clause learning (CDCL) process, improving the efficiency of Boolean satisfiability (SAT) so…

Reinforcement Learning

On Multi-Agent Deep Deterministic Policy Gradients and their Explainability for SMARTS Environment

2023-01-20 · Ansh Mittal, Aditya Malte

Multi-Agent RL or MARL is one of the complex problems in Autonomous Driving literature that hampers the release of fully-autonomous vehicles today. Several simulators have been in iteration after their inception to mitig…

Autonomous DrivingAutonomous Vehicles

Combining Machine Learning with Computational Fluid Dynamics using OpenFOAM and SmartSim

2024-02-25 · Tomislav Maric, Mohammed Elwardi Fadeli, Alessandro Rigazzi, Andrew Shao 외

Combining machine learning (ML) with computational fluid dynamics (CFD) opens many possibilities for improving simulations of technical and natural systems. However, CFD+ML algorithms require exchange of data, synchroniz…

SmartSearch: Process Reward-Guided Query Refinement for Search Agents

2026-01-08 · Tongyu Wen, Guanting Dong, Zhicheng Dou arxiv

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoni…

Information Retrieval