paper-with-me

홈 › Papers

Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations

2026-03-12 · Fatemeh Naeinian, Ali Hamza, Haoran Zhu, Anna Choromanska arxiv

End-to-end autonomous driving models are typically trained on multi-city datasets using supervised ImageNet-pretrained backbones, yet their ability to generalize to unseen cities remains largely unexamined. When training and evaluation data are geographically mixed, models may implicitly rely on city-specific cues, masking failure modes that would occur under real-world domain shifts when generalizing to new locations. In this work, we formulate zero-shot cross-city transfer as a controlled representation-level stress test for end-to-end autonomous driving and ask how visual pretraining affects transfer behavior under geographic domain shift. We conduct a comprehensive study by integrating self-supervised backbones I-JEPA, DINOv2, and MAE into planning frameworks. We evaluate performance under strict geographic splits on nuScenes in the open-loop setting and on NAVSIM in the closed-loop evaluation protocol. Our experiments reveal a substantial generalization gap when transferring models across cities with different road topologies, traffic conventions, and visual environments. In open-loop evaluation, a supervised backbone exhibits severe degradation when transferring between cities, yet some domain-specific self-supervised methods can substantially reduce both displacement and collision degradation. In closed-loop evaluation, self-supervised pretraining improves average out-of-distribution PDMS in several single-city training settings. Our results provide empirical evidence that representation learning influences the robustness of cross-city planning and motivate zero-shot geographic transfer as an important stress test for evaluating end-to-end autonomous driving systems.

📄 PDF Abstract BibTeX arXiv:2603.11417

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningAutonomous Driving

Similar Papers 제목 키워드 기반

A Generalizable Physics-guided Causal Model for Trajectory Prediction in Autonomous Driving

2026-02-15 · Zhenyu Zong, Yuchen Wang, Haohong Lin, Lu Gan 외 arxiv

Trajectory prediction for traffic agents is critical for safe autonomous driving. However, achieving effective zero-shot generalization in previously unseen domains remains a significant challenge. Motivated by the consi…

Zero-shot GeneralizationTrajectory PredictionAutonomous Driving

Bridging Performance and Generalization in Reinforcement Learning for Agile Flight

2026-06-25 · Jonathan Green, Jiaxu Xing, Nico Messikommer, Angel Romero 외 arxiv

Autonomous drone racing is a fundamentally challenging regime for autonomous aerial robots, requiring time-optimal control while operating under persistent actuation saturation. While reinforcement learning (RL) has achi…

Zero-shot GeneralizationReinforcement LearningTest-time Adaptation

PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Prompts

2026-03-02 · Xianqi Wang, Hao Yang, Hangtian Wang, Junda Cheng 외 arxiv

Modern stereo matching methods have leveraged monocular depth foundation models to achieve superior zero-shot generalization performance. However, most existing methods primarily focus on extracting robust features for c…

Zero-shot Generalization

SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies

2021-06-17 · Linxi Fan, Guanzhi Wang, De-An Huang, Zhiding Yu 외

Generalization has been a long-standing challenge for reinforcement learning (RL). Visual RL, in particular, can be easily distracted by irrelevant factors in high-dimensional observation space. In this work, we consider…

Autonomous DrivingImage AugmentationReinforcement Learning (RL)Representation Learning+1

CityGen: Structure-Guided City-Style Synthesis for Cross-City Autonomous Driving

2026-05-28 · Zezhong Qian, Zhao Yang, Lu Tan, Zhihao Yan 외 arxiv

Autonomous driving systems are commonly trained and evaluated within limited geographic regions, which hinders their scalability when deployed in new cities. However, significant domain shifts in appearance, road topolog…

Synthetic Data GenerationAutonomous DrivingData AugmentationDomain Adaptation