paper-with-me

Papers

Prompt-Guided Environmentally Consistent Adversarial Patch

2024-11-15 · CHAOQUN LI, Huanqian Yan, Lifeng Zhou, Tairan Chen, Zhuodong Liu, Hang Su

Adversarial attacks in the physical world pose a significant threat to the security of vision-based systems, such as facial recognition and autonomous driving. Existing adversarial patch methods primarily focus on improving attack performance, but they often produce patches that are easily detectable by humans and struggle to achieve environmental consistency, i.e., blending patches into the environment. This paper introduces a novel approach for generating adversarial patches, which addresses both the visual naturalness and environmental consistency of the patches. We propose Prompt-Guided Environmentally Consistent Adversarial Patch (PG-ECAP), a method that aligns the patch with the environment to ensure seamless integration into the environment. The approach leverages diffusion models to generate patches that are both environmental consistency and effective in evading detection. To further enhance the naturalness and consistency, we introduce two alignment losses: Prompt Alignment Loss and Latent Space Alignment Loss, ensuring that the generated patch maintains its adversarial properties while fitting naturally within its environment. Extensive experiments in both digital and physical domains demonstrate that PG-ECAP outperforms existing methods in attack success rate and environmental consistency.

📄 PDF Abstract BibTeX arXiv:2411.10498

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

SHIELD: Classifier-Guided Prompting for Robust and Safer LVLMs

2025-10-15 · Juan Ren, Mark Dras, Usman Naseem arxiv

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lig…

Multimodal Reasoning

DIFFender: Diffusion-Based Adversarial Defense against Patch Attacks

2023-06-15 · Caixin Kang, Yinpeng Dong, Zhengyi Wang, Shouwei Ruan 외

Adversarial attacks, particularly patch attacks, pose significant threats to the robustness and reliability of deep learning models. Developing reliable defenses against patch attacks is crucial for real-world applicatio…

Adversarial DefenseFace Recognitionimage-classificationImage Classification

Generating Transferable and Stealthy Adversarial Patch via Attention-guided Adversarial Inpainting

2023-08-10 · YanJie Li, Mingxing Duan, Xuelong Dai, Bin Xiao

Adversarial patch attacks can fool the face recognition (FR) models via small patches. However, previous adversarial patch attacks often result in unnatural patterns that are easily noticeable. Generating transferable an…

Face Recognition

Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object

2026-03-05 · Chanmi Lee, Minsung Yoon, Woojae Kim, Sebin Lee 외 arxiv

Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups,…

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems

2025-08-07 · Qi Guo, Xiaojun Jia, Shanmin Pang, Simeng Qin 외 arxiv

Multimodal Large Language Models (MLLMs) are becoming integral to autonomous driving (AD) systems due to their strong vision-language reasoning capabilities. However, MLLMs are vulnerable to adversarial attacks, particul…

Autonomous DrivingObject Detection