Role of Spatial Context in Adversarial Robustness for Object Detection
The benefits of utilizing spatial context in fast object detection algorithms have been studied extensively. Detectors increase inference speed by doing a single forward pass per image which means they implicitly use contextual reasoning for their predictions. However, one can show that an adversary can design adversarial patches which do not overlap with any objects of interest in the scene and exploit contextual reasoning to fool standard detectors. In this paper, we examine this problem and design category specific adversarial patches which make a widely used object detector like YOLO blind to an attacker chosen object category. We also show that limiting the use of spatial context during object detector training improves robustness to such adversaries. We believe the existence of context based adversarial attacks is concerning since the adversarial patch can affect predictions without being in vicinity of any objects of interest. Hence, defending against such attacks becomes challenging and we urge the research community to give attention to this vulnerability.
Code (1)
Tasks
Adversarial AttackAdversarial RobustnessObjectobject-detectionObject DetectionReal-Time Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pareto Adversarial Robustness: Balancing Spatial Robustness and Sensitivity-based Robustness
Adversarial robustness, which primarily comprises sensitivity-based robustness and spatial robustness, plays an integral part in achieving robust generalization. In this paper, we endeavor to design strategies to achieve…
Adversarial RobustnessSensitivityQuality Text, Robust Vision: The Role of Language in Enhancing Visual Robustness of Vision-Language Models
Defending pre-trained vision-language models (VLMs), such as CLIP, against adversarial attacks is crucial, as these models are widely used in diverse zero-shot tasks, including image classification. However, existing adv…
Representation LearningAdversarial RobustnessImage ClassificationLRR: Language-Driven Resamplable Continuous Representation against Adversarial Tracking Attacks
Visual object tracking plays a critical role in visual-based autonomous systems, as it aims to estimate the position and size of the object of interest within a live video. Despite significant progress made in this field…
ObjectObject TrackingVisual Object TrackingAdversarial Text Generation with Dynamic Contextual Perturbation
Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing m…
Adversarial TextText GenerationThe Meeseeks Mesh: Spatially Consistent 3D Adversarial Objects for BEV Detector
3D object detection is a critical component in autonomous driving systems. It allows real-time recognition and detection of vehicles, pedestrians and obstacles under varying environmental conditions. Among existing metho…
3D Object DetectionAutonomous DrivingObjectobject-detection+1