Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patches
Deep learning has substantially boosted the performance of Monocular Depth Estimation (MDE), a critical component in fully vision-based autonomous driving (AD) systems (e.g., Tesla and Toyota). In this work, we develop an attack against learning-based MDE. In particular, we use an optimization-based method to systematically generate stealthy physical-object-oriented adversarial patches to attack depth estimation. We balance the stealth and effectiveness of our attack with object-oriented adversarial design, sensitive region localization, and natural style camouflage. Using real-world driving scenarios, we evaluate our attack on concurrent MDE models and a representative downstream task for AD (i.e., 3D object detection). Experimental results show that our method can generate stealthy, effective, and robust adversarial patches for different target objects and models and achieves more than 6 meters mean depth estimation error and 93% attack success rate (ASR) in object detection with a patch of 1/9 of the vehicle's rear area. Field tests on three different driving routes with a real vehicle indicate that we cause over 6 meters mean depth estimation error and reduce the object detection rate from 90.70% to 5.16% in continuous video frames.
Code (2)
Tasks
3D Object DetectionAutonomous DrivingDepth EstimationMonocular Depth EstimationObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks
Monocular Depth Estimation (MDE) is a critical component in applications such as autonomous driving. There are various attacks against MDE networks. These attacks, especially the physical ones, pose a great threat to the…
Adversarial RobustnessAutonomous DrivingContrastive LearningDepth Estimation+1Adversarial Patch Attacks on Monocular Depth Estimation Networks
Thanks to the excellent learning capability of deep convolutional neural networks (CNN), monocular depth estimation using CNNs has achieved great success in recent years. However, depth estimation from a monocular image …
Adversarial AttackDepth EstimationMonocular Depth EstimationSelf-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks
Monocular Depth Estimation (MDE) plays a vital role in applications such as autonomous driving. However, various attacks target MDE models, with physical attacks posing significant threats to system security. Traditional…
Adversarial RobustnessAutonomous DrivingContrastive LearningDepth Estimation+1BadDepth: Backdoor Attacks Against Monocular Depth Estimation in the Physical World
In recent years, deep learning-based Monocular Depth Estimation (MDE) models have been widely applied in fields such as autonomous driving and robotics. However, their vulnerability to backdoor attacks remains unexplored…
Autonomous DrivingBackdoor AttackDepth CompletionDepth Estimation+3Optical Lens Attack on Deep Learning Based Monocular Depth Estimation
Monocular Depth Estimation (MDE) plays a crucial role in vision-based Autonomous Driving (AD) systems. It utilizes a single-camera image to determine the depth of objects, facilitating driving decisions such as braking a…
Autonomous DrivingDeep LearningDepth EstimationMonocular Depth Estimation