paper-with-me

홈 › Papers

Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning

2023-07-14 · ICCV 2023 1 · Byung-Kwan Lee, Junho Kim, Yong Man Ro

Adversarial examples derived from deliberately crafted perturbations on visual inputs can easily harm decision process of deep neural networks. To prevent potential threats, various adversarial training-based defense methods have grown rapidly and become a de facto standard approach for robustness. Despite recent competitive achievements, we observe that adversarial vulnerability varies across targets and certain vulnerabilities remain prevalent. Intriguingly, such peculiar phenomenon cannot be relieved even with deeper architectures and advanced defense methods. To address this issue, in this paper, we introduce a causal approach called Adversarial Double Machine Learning (ADML), which allows us to quantify the degree of adversarial vulnerability for network predictions and capture the effect of treatments on outcome of interests. ADML can directly estimate causal parameter of adversarial perturbations per se and mitigate negative effects that can potentially damage robustness, bridging a causal perspective into the adversarial vulnerability. Through extensive experiments on various CNN and Transformer architectures, we corroborate that ADML improves adversarial robustness with large margins and relieve the empirical observation.

📄 PDF Abstract BibTeX arXiv:2307.07250

Code (1)

ByungKwanLee/Double-Debiased-Adversary 공식 구현 pytorch

Tasks

Adversarial Robustnessparameter estimation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

CausalAdv: Adversarial Robustness through the Lens of Causality

2021-06-11 · ICLR 2022 4 · Yonggang Zhang, Mingming Gong, Tongliang Liu, Gang Niu 외

The adversarial vulnerability of deep neural networks has attracted significant attention in machine learning. As causal reasoning has an instinct for modelling distribution change, it is essential to incorporate causali…

Adversarial AttackAdversarial Robustness

Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs

2026-07-08 · Anupam Wagle, Ifrat Ikhtear Uddin, Chaowei Zhang, Longwei Wang arxiv

Large language models (LLMs) exhibit remarkable capabilities but remain highly vulnerable to adversarial prompts and jailbreak attacks. Existing approaches primarily analyze these failures through input-output behaviors …

Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression

2023-03-02 · CVPR 2023 1 · Junho Kim, Byung-Kwan Lee, Yong Man Ro

The origin of adversarial examples is still inexplicable in research fields, and it arouses arguments from various viewpoints, albeit comprehensive investigations. In this paper, we propose a way of delving into the unex…

Adversarial RobustnessPrediction

Mitigation of Policy Manipulation Attacks on Deep Q-Networks with Parameter-Space Noise

2018-06-04 · Vahid Behzadan, Arslan Munir

Recent developments have established the vulnerability of deep reinforcement learning to policy manipulation attacks via intentionally perturbed inputs, known as adversarial examples. In this work, we propose a technique…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

CausAdv: A Causal-based Framework for Detecting Adversarial Examples

2024-10-29 · Hichem Debbi

Deep learning has led to tremendous success in many real-world applications of computer vision, thanks to sophisticated architectures such as Convolutional neural networks (CNNs). However, CNNs have been shown to be vuln…

Adversarial RobustnesscounterfactualCounterfactual Reasoning