paper-with-me

홈 › Papers

Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches

2024-03-31 · Lingxuan Wu, Xiao Yang, Yinpeng Dong, Liuwei Xie, Hang Su, Jun Zhu

The vulnerability of deep neural networks to adversarial patches has motivated numerous defense strategies for boosting model robustness. However, the prevailing defenses depend on single observation or pre-established adversary information to counter adversarial patches, often failing to be confronted with unseen or adaptive adversarial attacks and easily exhibiting unsatisfying performance in dynamic 3D environments. Inspired by active human perception and recurrent feedback mechanisms, we develop Embodied Active Defense (EAD), a proactive defensive strategy that actively contextualizes environmental information to address misaligned adversarial patches in 3D real-world settings. To achieve this, EAD develops two central recurrent sub-modules, i.e., a perception module and a policy module, to implement two critical functions of active vision. These models recurrently process a series of beliefs and observations, facilitating progressive refinement of their comprehension of the target object and enabling the development of strategic actions to counter adversarial patches in 3D environments. To optimize learning efficiency, we incorporate a differentiable approximation of environmental dynamics and deploy patches that are agnostic to the adversary strategies. Extensive experiments demonstrate that EAD substantially enhances robustness against a variety of patches within just a few steps through its action policy in safety-critical tasks (e.g., face recognition and object detection), without compromising standard accuracy. Furthermore, due to the attack-agnostic characteristic, EAD facilitates excellent generalization to unseen attacks, diminishing the averaged attack success rate by 95 percent across a range of unseen adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2404.00540

Code (0)

등록된 구현이 없습니다.

Tasks

Face Recognitionobject-detectionObject Detection

Similar Papers 제목 키워드 기반

Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation

2026-07-30 · Fazhong Liu, Zhuoyan Chen, Haozhen Tan, Yan Meng 외 arxiv

World models give embodied AI a predictive core: they compress observations into states, simulate action-conditioned futures, and enable planning beyond reactive control. This predictive layer, however, opens a new secur…

Representation Learning

NEXUS: Continual Learning of Symbolic Constraints for Safe and Robust Embodied Planning

2026-05-10 · Tiehan Cui, Peipei Liu, Yanxu Mao, Congying Liu 외 arxiv

While Large Language Models (LLMs) have catalyzed progress in embodied intelligence, a fundamental gap between their inherent probabilistic uncertainty and the strict determinism and verifiable safety required in the phy…

Continual Learning

EmboMatrix: A Scalable Training-Ground for Embodied Decision-Making

2025-10-14 · Zixing Lei, Sheng Yin, Yichen Xiong, Yuanzhuo Ding 외 arxiv

Embodied decision-making enables agents to translate high-level goals into executable actions through continuous interactions within the physical world, forming a cornerstone of general-purpose embodied intelligence. Lar…

Scene Generation

On Interactive Machine Learning and the Potential of Cognitive Feedback

2020-03-23 · Chris J. Michael, Dina Acklin, Jaelle Scheuerman

In order to increase productivity, capability, and data exploitation, numerous defense applications are experiencing an integration of state-of-the-art machine learning and AI into their architectures. Especially for def…

BIG-bench Machine Learning

Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments

2025-07-24 · Xiao Yang, Lingxuan Wu, Lizhong Wang, Chengyang Ying 외 arxiv

Adversarial attacks in 3D environments have emerged as a critical threat to the reliability of visual perception systems, particularly in safety-sensitive applications such as identity verification and autonomous driving…

3D Object ClassificationAutonomous DrivingFace Recognition