홈 › Papers

CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving

2025-10-14 · Xiaoji Zheng, Ziyuan Yang, Yanhao Chen, Yuhang Peng, Yuanrong Tang, Gengyuan Liu, Bokui Chen, Jiangtao Gong arxiv

End-to-end autonomous driving models trained with imitation learning (IL) often generalize poorly, particularly in long-tail scenarios where expert demonstrations are sparse. Reinforcement learning (RL) can provide complementary task-level supervision, but applying RL to real-world autonomous driving is challenging in offline settings without interactive simulators, where datasets are dominated by expert actions and provide limited behavioral diversity. We propose CoIRL-AD, a competitive dual-policy framework that integrates IL and RL under a unified offline training regime. CoIRL-AD decouples imitation and reward optimization into separate actors to alleviate objective conflicts, uses imagined future rollouts for long-horizon reward estimation, and introduces a competition mechanism that selectively transfers beneficial behaviors while keeping RL anchored to expert-like driving. Experiments on the nuScenes benchmark show that CoIRL-AD consistently improves robustness over strong IL-based baselines, with especially large gains in cross-city generalization and long-tail scenarios. Code is available at: https://github.com/SEU-zxj/CoIRL-AD.

📄 PDF Abstract BibTeX arXiv:2510.12560

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning Autonomous Driving

Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving

2026-03-14 · Zhexi Lian, Haoran Wang, Xuerun Yan, Weimeng Lin 외 arxiv

End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demonstrations. To overcome this limitation, recent methods incorporate reinforcem…

Reinforcement Learning Autonomous Driving

Multiagent Cooperation and Competition with Deep Reinforcement Learning

2015-11-27 · Ardi Tampuu, Tambet Matiisen, Dorian Kodelja, Ilya Kuzovkin 외

Multiagent systems appear in most social, economical, and political situations. In the present work we extend the Deep Q-Learning Network architecture proposed by Google DeepMind to multiagent environments and investigat…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Hyperbolic VAE via Latent Gaussian Distributions

2022-09-30 · NeurIPS 2023 11 · Seunghyuk Cho, Juyong Lee, Dongwoo Kim

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose latent space consists of a set of Gaussian distributions. It is known that the set of the univariate Gaussian distributions with the Fisher informati…

Density Estimation Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning

LACO: Adaptive Latent Communication for Collaborative Driving

2026-05-21 · Tianhao Chen, Yuheng Wu, Dongman Lee arxiv

Collaborative driving aims to improve safety and efficiency by enabling connected vehicles to coordinate under partial observability. Recent approaches have evolved from sharing visual features for perception to exchangi…

Knowledge Distillation Decision Making

When Collaborative Filtering Meets Reinforcement Learning

2019-02-02 · Yu Lei, Wenjie Li

In this paper, we study a multi-step interactive recommendation problem, where the item recommended at current step may affect the quality of future recommendations. To address the problem, we develop a novel and effecti…

Collaborative Filtering Interactive Recommendation reinforcement-learning Reinforcement Learning+1