paper-with-me

Papers

Diffusion Policy Attacker: Crafting Adversarial Attacks for Diffusion-based Policies

2024-05-29 · Yipu Chen, Haotian Xue, Yongxin Chen

Diffusion models (DMs) have emerged as a promising approach for behavior cloning (BC). Diffusion policies (DP) based on DMs have elevated BC performance to new heights, demonstrating robust efficacy across diverse tasks, coupled with their inherent flexibility and ease of implementation. Despite the increasing adoption of DP as a foundation for policy generation, the critical issue of safety remains largely unexplored. While previous attempts have targeted deep policy networks, DP used diffusion models as the policy network, making it ineffective to be attacked using previous methods because of its chained structure and randomness injected. In this paper, we undertake a comprehensive examination of DP safety concerns by introducing adversarial scenarios, encompassing offline and online attacks, and global and patch-based attacks. We propose DP-Attacker, a suite of algorithms that can craft effective adversarial attacks across all aforementioned scenarios. We conduct attacks on pre-trained diffusion policies across various manipulation tasks. Through extensive experiments, we demonstrate that DP-Attacker has the capability to significantly decrease the success rate of DP for all scenarios. Particularly in offline scenarios, DP-Attacker can generate highly transferable perturbations applicable to all frames. Furthermore, we illustrate the creation of adversarial physical patches that, when applied to the environment, effectively deceive the model. Video results are put in: https://sites.google.com/view/diffusion-policy-attacker.

📄 PDF Abstract BibTeX arXiv:2405.19424

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Optimal Attacks on Reinforcement Learning Policies

2019-07-31 · Alessio Russo, Alexandre Proutiere

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Diffusion Attack: Leveraging Stable Diffusion for Naturalistic Image Attacking

2024-03-21 · Qianyu Guo, Jiaming Fu, Yawen Lu, Dongming Gan

In Virtual Reality (VR), adversarial attack remains a significant security threat. Most deep learning-based methods for physical and digital adversarial attacks focus on enhancing attack performance by crafting adversari…

Adversarial AttackStyle Transfer

Crafter: Facial Feature Crafting against Inversion-based Identity Theft on Deep Models

2024-01-14 · Shiming Wang, Zhe Ji, Liyao Xiang, Hao Zhang 외

With the increased capabilities at the edge (e.g., mobile device) and more stringent privacy requirement, it becomes a recent trend for deep learning-enabled applications to pre-process sensitive raw data at the edge and…

Test-time Adversarial Takeover: A Real-time Hijacking Interface against Robotic Diffusion Policies

2026-06-09 · Zi Yin, Peilin Chai, Siyuan Huang, Zhanhao Hu arxiv

Diffusion-based action generation has become a foundational component of embodied AI, but its reliance on visual conditioning leaves deployed visuomotor policies vulnerable to adversarial manipulation. Most prior attacks…

Ensemble Noise Simulation to Handle Uncertainty about Gradient-based Adversarial Attacks

2020-01-26 · Rehana Mahfuz, Rajeev Sahay, Aly El Gamal

Gradient-based adversarial attacks on neural networks can be crafted in a variety of ways by varying either how the attack algorithm relies on the gradient, the network architecture used for crafting the attack, or both.…

Denoising