paper-with-me

홈 › Papers

Scanning Trojaned Models Using Out-of-Distribution Samples

2025-01-28 · Hossein Mirzaei, Ali Ansari, Bahar Dibaei Nia, Mojtaba Nafez, Moein Madadi, Sepehr Rezaee, Zeinab Sadat Taghavi, Arad Maleki, Kian Shamsaie, Mahdi Hajialilue, Jafar Habibi, Mohammad Sabokrou, Mohammad Hossein Rohban

Scanning for trojan (backdoor) in deep neural networks is crucial due to their significant real-world applications. There has been an increasing focus on developing effective general trojan scanning methods across various trojan attacks. Despite advancements, there remains a shortage of methods that perform effectively without preconceived assumptions about the backdoor attack method. Additionally, we have observed that current methods struggle to identify classifiers trojaned using adversarial training. Motivated by these challenges, our study introduces a novel scanning method named TRODO (TROjan scanning by Detection of adversarial shifts in Out-of-distribution samples). TRODO leverages the concept of "blind spots"--regions where trojaned classifiers erroneously identify out-of-distribution (OOD) samples as in-distribution (ID). We scan for these blind spots by adversarially shifting OOD samples towards in-distribution. The increased likelihood of perturbed OOD samples being classified as ID serves as a signature for trojan detection. TRODO is both trojan and label mapping agnostic, effective even against adversarially trained trojaned classifiers. It is applicable even in scenarios where training data is absent, demonstrating high accuracy and adaptability across various scenarios and datasets, highlighting its potential as a robust trojan scanning strategy.

📄 PDF Abstract BibTeX arXiv:2501.17151

Code (1)

rohban-lab/trodo 공식 구현 pytorch

Tasks

Backdoor Attack

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Topological Detection of Trojaned Neural Networks

2021-06-11 · NeurIPS 2021 12 · Songzhu Zheng, Yikai Zhang, Hubert Wagner, Mayank Goswami 외

Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can lat…

Game of Trojans: Adaptive Adversaries Against Output-based Trojaned-Model Detectors

2024-02-12 · Dinuka Sahabandu, Xiaojun Xu, Arezoo Rajabi, Luyao Niu 외

We propose and analyze an adaptive adversary that can retrain a Trojaned DNN and is also aware of SOTA output-based Trojaned model detectors. We show that such an adversary can ensure (1) high accuracy on both trigger-em…

On Trojan Signatures in Large Language Models of Code

2024-02-23 · Aftab Hussain, Md Rafiqul Islam Rabin, Mohammad Amin Alipour

Trojan signatures, as described by Fields et al. (2021), are noticeable differences in the distribution of the trojaned class parameters (weights) and the non-trojaned class parameters of the trojaned model, that can be …

Binary ClassificationDefect Detection

Detecting AI Trojans Using Meta Neural Analysis

2019-10-08 · Xiaojun Xu, Qi. Wang, Huichen Li, Nikita Borisov 외

In machine learning Trojan attacks, an adversary trains a corrupted model that obtains good performance on normal data but behaves maliciously on data samples with certain trigger patterns. Several approaches have been p…

Data Poisoning

EX-RAY: Distinguishing Injected Backdoor from Natural Features in Neural Networks by Examining Differential Feature Symmetry

2021-03-16 · Yingqi Liu, Guangyu Shen, Guanhong Tao, Zhenting Wang 외

Backdoor attack injects malicious behavior to models such that inputs embedded with triggers are misclassified to a target label desired by the attacker. However, natural features may behave like triggers, causing miscla…

Backdoor Attack