paper-with-me

Papers

DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systems

2021-10-07 · Ce Zhou, Qiben Yan, Yan Shi, Lichao Sun

Depth estimation-based obstacle avoidance has been widely adopted by autonomous systems (drones and vehicles) for safety purpose. It normally relies on a stereo camera to automatically detect obstacles and make flying/driving decisions, e.g., stopping several meters ahead of the obstacle in the path or moving away from the detected obstacle. In this paper, we explore new security risks associated with the stereo vision-based depth estimation algorithms used for obstacle avoidance. By exploiting the weaknesses of the stereo matching in depth estimation algorithms and the lens flare effect in optical imaging, we propose DoubleStar, a long-range attack that injects fake obstacle depth by projecting pure light from two complementary light sources. DoubleStar includes two distinctive attack formats: beams attack and orbs attack, which leverage projected light beams and lens flare orbs respectively to cause false depth perception. We successfully attack two commercial stereo cameras designed for autonomous systems (ZED and Intel RealSense). The visualization of fake depth perceived by the stereo cameras illustrates the false stereo matching induced by DoubleStar. We further use Ardupilot to simulate the attack and demonstrate its impact on drones. To validate the attack on real systems, we perform a real-world attack towards a commercial drone equipped with state-of-the-art obstacle avoidance algorithms. Our attack can continuously bring a flying drone to a sudden stop or drift it away across a long distance under various lighting conditions, even bypassing sensor fusion mechanisms. Specifically, our experimental results show that DoubleStar creates fake depth up to 15 meters in distance at night and up to 8 meters during the daytime. To mitigate this newly discovered threat, we provide discussions on potential countermeasures to defend against DoubleStar.

📄 PDF Abstract BibTeX arXiv:2110.03154

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationSensor FusionStereo Matching

Similar Papers 제목 키워드 기반

Adversarial Attacks on Monocular Depth Estimation

2020-03-23 · Ziqi Zhang, Xinge Zhu, Yingwei Li, Xiangqun Chen 외

Recent advances of deep learning have brought exceptional performance on many computer vision tasks such as semantic segmentation and depth estimation. However, the vulnerability of deep neural networks towards adversari…

Autonomous DrivingDepth EstimationMonocular Depth EstimationRobot Navigation+2

Gated Stereo: Joint Depth Estimation from Gated and Wide-Baseline Active Stereo Cues

2023-05-22 · CVPR 2023 1 · Stefanie Walz, Mario Bijelic, Andrea Ramazzina, Amanpreet Walia 외

We propose Gated Stereo, a high-resolution and long-range depth estimation technique that operates on active gated stereo images. Using active and high dynamic range passive captures, Gated Stereo exploits multi-view cue…

Depth EstimationDepth Prediction

MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation

2024-06-06 · Ionuţ Grigore, Călin-Adrian Popa

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependen…

DecoderDepth EstimationMambaMonocular Depth Estimation

Range-Agnostic Multi-View Depth Estimation With Keyframe Selection

2024-01-25 · Andrea Conti, Matteo Poggi, Valerio Cambareri, Stefano Mattoccia

Methods for 3D reconstruction from posed frames require prior knowledge about the scene metric range, usually to recover matching cues along the epipolar lines and narrow the search range. However, such prior might not b…

3D ReconstructionDepth Estimation

Optical Lens Attack on Deep Learning Based Monocular Depth Estimation

2024-09-25 · Ce Zhou, Qiben Yan, Daniel Kent, Guangjing Wang 외

Monocular Depth Estimation (MDE) plays a crucial role in vision-based Autonomous Driving (AD) systems. It utilizes a single-camera image to determine the depth of objects, facilitating driving decisions such as braking a…

Autonomous DrivingDeep LearningDepth EstimationMonocular Depth Estimation