On Robustness of Lane Detection Models to Physical-World Adversarial Attacks in Autonomous Driving
After the 2017 TuSimple Lane Detection Challenge, its evaluation based on accuracy and F1 score has become the de facto standard to measure the performance of lane detection methods. In this work, we conduct the first large-scale empirical study to evaluate the robustness of state-of-the-art lane detection methods under physical-world adversarial attacks in autonomous driving. We evaluate 4 major types of lane detection approaches with the conventional evaluation and end-to-end evaluation in autonomous driving scenarios and then discuss the security proprieties of each lane detection model. We demonstrate that the conventional evaluation fails to reflect the robustness in end-to-end autonomous driving scenarios. Our results show that the most robust model on the conventional metrics is the least robust in the end-to-end evaluation. Although the competition dataset and its metrics have played a substantial role in developing performant lane detection methods along with the rapid development of deep neural networks, the conventional evaluation is becoming obsolete and the gap between the metrics and practicality is critical. We hope that our study will help the community make further progress in building a more comprehensive framework to evaluate lane detection models.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingLane DetectionSimilar Papers 제목 키워드 기반
Benchmarking the Physical-world Adversarial Robustness of Vehicle Detection
Adversarial attacks in the physical world can harm the robustness of detection models. Evaluating the robustness of detection models in the physical world can be challenging due to the time-consuming and labor-intensive …
Adversarial AttackAdversarial RobustnessBenchmarkingvehicle detectionPhysical Backdoor Attacks to Lane Detection Systems in Autonomous Driving
Modern autonomous vehicles adopt state-of-the-art DNN models to interpret the sensor data and perceive the environment. However, DNN models are vulnerable to different types of adversarial attacks, which pose significant…
Autonomous DrivingAutonomous VehiclesBackdoor AttackLane DetectionRevisiting Physically Realizable Adversarial Object Attack against LiDAR-based Detection: Clarifying Problem Formulation and Experimental Protocols
Adversarial robustness in LiDAR-based 3D object detection is a critical research area due to its widespread application in real-world scenarios. While many digital attacks manipulate point clouds or meshes, they often la…
Adversarial Robustness3D Object DetectionPoint CloudsExploring the Physical World Adversarial Robustness of Vehicle Detection
Adversarial attacks can compromise the robustness of real-world detection models. However, evaluating these models under real-world conditions poses challenges due to resource-intensive experiments. Virtual simulations o…
Adversarial AttackAdversarial Robustnessvehicle detectionTransferable Physical-World Adversarial Patches Against Object Detection in Autonomous Driving
Deep learning drives major advances in autonomous driving (AD), where object detectors are central to perception. However, adversarial attacks pose significant threats to the reliability and safety of these systems, with…
Autonomous DrivingData AugmentationObject Detection