Adversarial Attack Attribution: Discovering Attributable Signals in Adversarial ML Attacks
Machine Learning (ML) models are known to be vulnerable to adversarial inputs and researchers have demonstrated that even production systems, such as self-driving cars and ML-as-a-service offerings, are susceptible. These systems represent a target for bad actors. Their disruption can cause real physical and economic harm. When attacks on production ML systems occur, the ability to attribute the attack to the responsible threat group is a critical step in formulating a response and holding the attackers accountable. We pose the following question: can adversarially perturbed inputs be attributed to the particular methods used to generate the attack? In other words, is there a way to find a signal in these attacks that exposes the attack algorithm, model architecture, or hyperparameters used in the attack? We introduce the concept of adversarial attack attribution and create a simple supervised learning experimental framework to examine the feasibility of discovering attributable signals in adversarial attacks. We find that it is possible to differentiate attacks generated with different attack algorithms, models, and hyperparameters on both the CIFAR-10 and MNIST datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackAttributeSelf-Driving CarsSimilar Papers 제목 키워드 기반
Think Before You Attribute: Improving the Performance of LLMs Attribution Systems
Large Language Models (LLMs) are increasingly applied in various science domains, yet their broader adoption remains constrained by a critical challenge: the lack of trustworthy, verifiable outputs. Current LLMs often ge…
AttributeRAGSentenceSHIELD: Thwarting Code Authorship Attribution
Authorship attribution has become increasingly accurate, posing a serious privacy risk for programmers who wish to remain anonymous. In this paper, we introduce SHIELD to examine the robustness of different code authorsh…
Authorship AttributionAdversarial Attacks on Data Attribution
Data attribution aims to quantify the contribution of individual training data points to the outputs of an AI model, which has been used to measure the value of training data and compensate data providers. Given the impa…
Adversarial AttackAdversarial Robustnessimage-classificationImage Classification+2Advancing Large Language Model Attribution through Self-Improving
Teaching large language models (LLMs) to generate text with citations to evidence sources can mitigate hallucinations and enhance verifiability in information-seeking systems. However, improving this capability requires …
Language ModelingLanguage ModellingLarge Language ModelOpen-Domain Question Answering+1Misleading Authorship Attribution of Source Code using Adversarial Learning
In this paper, we present a novel attack against authorship attribution of source code. We exploit that recent attribution methods rest on machine learning and thus can be deceived by adversarial examples of source code.…
Authorship Attribution