Attacks on Perception-Based Control Systems: Modeling and Fundamental Limits
We study the performance of perception-based control systems in the presence of attacks, and provide methods for modeling and analysis of their resiliency to stealthy attacks on both physical and perception-based sensing. Specifically, we consider a general setup with a nonlinear affine physical plant controlled with a perception-based controller that maps both the physical (e.g., IMUs) and perceptual (e.g., camera) sensing to the control input; the system is also equipped with a statistical or learning-based anomaly detector (AD). We model the attacks in the most general form, and introduce the notions of attack effectiveness and stealthiness independent of the used AD. In such setting, we consider attacks with different levels of runtime knowledge about the plant. We find sufficient conditions for existence of stealthy effective attacks that force the plant into an unsafe region without being detected by any AD. We show that as the open-loop unstable plant dynamics diverges faster and the closed-loop system converges faster to an equilibrium point, the system is more vulnerable to effective stealthy attacks. Also, depending on runtime information available to the attacker, the probability of attack remaining stealthy can be arbitrarily close to one, if the attacker's estimate of the plant's state is arbitrarily close to the true state; when an accurate estimate of the plant state is not available, the stealthiness level depends on the control performance in attack-free operation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Control Analysis and Design for Autonomous Vehicles Subject to Imperfect AI-Based Perception
Safety is a critical concern in autonomous vehicle (AV) systems, especially when AI-based sensing and perception modules are involved. However, due to the black box nature of AI algorithms, it makes closed-loop analysis …
Autonomous VehiclesEnhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attacks
There is a growing interest in integrating Large Language Models (LLMs) with autonomous driving (AD) systems. However, AD systems are vulnerable to attacks against their object detection and tracking (ODT) functions. Unf…
Autonomous DrivingDecision Makingobject-detectionObject DetectionAdversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving
In Autonomous Vehicles (AVs), one fundamental pillar is perception, which leverages sensors like cameras and LiDARs (Light Detection and Ranging) to understand the driving environment. Due to its direct impact on road sa…
Autonomous DrivingAutonomous VehiclesBIG-bench Machine Learningobject-detection+1End-to-end Uncertainty-based Mitigation of Adversarial Attacks to Automated Lane Centering
In the development of advanced driver-assistance systems (ADAS) and autonomous vehicles, machine learning techniques that are based on deep neural networks (DNNs) have been widely used for vehicle perception. These techn…
Autonomous DrivingAutonomous VehiclesSecurity and Resilience in Autonomous Vehicles: A Proactive Design Approach
Autonomous vehicles (AVs) promise efficient, clean and cost-effective transportation systems, but their reliance on sensors, wireless communications, and decision-making systems makes them vulnerable to cyberattacks and …
Autonomous VehiclesIntrusion DetectionAnomaly Detection