ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Driving
End-to-end differentiable learning for autonomous driving (AD) has recently become a prominent paradigm. One main bottleneck lies in its voracious appetite for high-quality labeled data e.g. 3D bounding boxes and semantic segmentation, which are notoriously expensive to manually annotate. The difficulty is further pronounced due to the prominent fact that the behaviors within samples in AD often suffer from long tailed distribution. In other words, a large part of collected data can be trivial (e.g. simply driving forward in a straight road) and only a few cases are safety-critical. In this paper, we explore a practically important yet under-explored problem about how to achieve sample and label efficiency for end-to-end AD. Specifically, we design a planning-oriented active learning method which progressively annotates part of collected raw data according to the proposed diversity and usefulness criteria for planning routes. Empirically, we show that our planning-oriented approach could outperform general active learning methods by a large margin. Notably, our method achieves comparable performance with state-of-the-art end-to-end AD methods - by using only 30% nuScenes data. We hope our work could inspire future works to explore end-to-end AD from a data-centric perspective in addition to methodology efforts.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAutonomous DrivingSemantic SegmentationSimilar Papers 제목 키워드 기반
WorldRFT: Latent World Model Planning with Reinforcement Fine-Tuning for Autonomous Driving
Latent World Models enhance scene representation through temporal self-supervised learning, presenting a perception annotation-free paradigm for end-to-end autonomous driving. However, the reconstruction-oriented represe…
Self-Supervised LearningRepresentation LearningReinforcement LearningAutonomous DrivingPlanning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
End-to-end autonomous driving has evolved from camera-to-control regression toward planning-oriented systems that use structured representations, trajectory-level outputs, and increasingly realistic evaluation protocols.…
Autonomous DrivingDME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving
In the field of autonomous driving, two important features of autonomous driving car systems are the explainability of decision logic and the accuracy of environmental perception. This paper introduces DME-Driver, a new …
Autonomous DrivingLanguage ModelingLanguage ModellingSelf-Driving CarsPerception in Plan: Coupled Perception and Planning for End-to-End Autonomous Driving
End-to-end autonomous driving has achieved remarkable advancements in recent years. Existing methods primarily follow a perception-planning paradigm, where perception and planning are executed sequentially within a fully…
Autonomous DrivingPlanning-oriented Autonomous Driving
Modern autonomous driving system is characterized as modular tasks in sequential order, i.e., perception, prediction, and planning. In order to perform a wide diversity of tasks and achieve advanced-level intelligence, c…
Autonomous DrivingBench2DriveNavSimPhilosophy+1