Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation
Knowledge graphs (KGs) have helped neural models improve performance on various knowledge-intensive tasks, like question answering and item recommendation. By using attention over the KG, such KG-augmented models can also "explain" which KG information was most relevant for making a given prediction. In this paper, we question whether these models are really behaving as we expect. We show that, through a reinforcement learning policy (or even simple heuristics), one can produce deceptively perturbed KGs, which maintain the downstream performance of the original KG while significantly deviating from the original KG's semantics and structure. Our findings raise doubts about KG-augmented models' ability to reason about KG information and give sensible explanations.
Code (1)
Tasks
Knowledge GraphsQuestion AnsweringRecommendation Systemsreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Indirect Adversarial Attacks via Poisoning Neighbors for Graph Convolutional Networks
Graph convolutional neural networks, which learn aggregations over neighbor nodes, have achieved great performance in node classification tasks. However, recent studies reported that such graph convolutional node classif…
General ClassificationNode ClassificationSingle-Class Target-Specific Attack against Interpretable Deep Learning Systems
In this paper, we present a novel Single-class target-specific Adversarial attack called SingleADV. The goal of SingleADV is to generate a universal perturbation that deceives the target model into confusing a specific c…
Adversarial AttackDeep LearningIntroducing Competition to Boost the Transferability of Targeted Adversarial Examples through Clean Feature Mixup
Deep neural networks are widely known to be susceptible to adversarial examples, which can cause incorrect predictions through subtle input modifications. These adversarial examples tend to be transferable between models…
Rethinking Impersonation and Dodging Attacks on Face Recognition Systems
Face Recognition (FR) systems can be easily deceived by adversarial examples that manipulate benign face images through imperceptible perturbations. Adversarial attacks on FR encompass two types: impersonation (targeted)…
Adversarial AttackFace RecognitionDecision-BADGE: Decision-based Adversarial Batch Attack with Directional Gradient Estimation
The susceptibility of deep neural networks (DNNs) to adversarial examples has prompted an increase in the deployment of adversarial attacks. Image-agnostic universal adversarial perturbations (UAPs) are much more threate…
Adversarial Attack