Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks
Monocular Depth Estimation (MDE) plays a vital role in applications such as autonomous driving. However, various attacks target MDE models, with physical attacks posing significant threats to system security. Traditional adversarial training methods, which require ground-truth labels, are not directly applicable to MDE models that lack ground-truth depth. Some self-supervised model hardening techniques (e.g., contrastive learning) overlook the domain knowledge of MDE, resulting in suboptimal performance. In this work, we introduce a novel self-supervised adversarial training approach for MDE models, leveraging view synthesis without the need for ground-truth depth. We enhance adversarial robustness against real-world attacks by incorporating L_0-norm-bounded perturbation during training. We evaluate our method against supervised learning-based and contrastive learning-based approaches specifically designed for MDE. Our experiments with two representative MDE networks demonstrate improved robustness against various adversarial attacks, with minimal impact on benign performance.
Code (1)
Tasks
Adversarial RobustnessAutonomous DrivingContrastive LearningDepth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Image Masking for Robust Self-Supervised Monocular Depth Estimation
Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth witho…
Autonomous DrivingDepth EstimationMonocular Depth EstimationMotion Estimation+1Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks
Monocular Depth Estimation (MDE) is a critical component in applications such as autonomous driving. There are various attacks against MDE networks. These attacks, especially the physical ones, pose a great threat to the…
Adversarial RobustnessAutonomous DrivingContrastive LearningDepth Estimation+1Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training
Learning a self-supervised Monocular Depth Estimation (MDE) model with great generalization remains significantly challenging. Despite the success of adversarial augmentation in the supervised learning generalization, na…
Data AugmentationDepth EstimationDomain GeneralizationMonocular Depth EstimationA high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation
This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervise…
Depth EstimationGenerative Adversarial NetworkMonocular Visual OdometryMulti-Task Learning+2On the Benefit of Adversarial Training for Monocular Depth Estimation
In this paper we address the benefit of adding adversarial training to the task of monocular depth estimation. A model can be trained in a self-supervised setting on stereo pairs of images, where depth (disparities) are …
Depth EstimationDepth PredictionGenerative Adversarial NetworkImage Reconstruction+1