paper-with-me

Papers

CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzing

2021-12-24 · Haibo Jin, Ruoxi Chen, Jinyin Chen, Haibin Zheng, Yang Zhang, Haohan Wang

The success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models. However, the backdoored pre-trained models can pose a significant trojan threat to the deployment of downstream DNNs. Numerous backdoor detection methods have been proposed but are limited to two aspects: (1) high sensitivity on trigger size, especially on stealthy attacks (i.e., blending attacks and defense adaptive attacks); (2) rely heavily on benign examples for reverse engineering. To address these challenges, we empirically observed that trojaned behaviors triggered by various trojan attacks can be attributed to the trojan path, composed of top-$k$ critical neurons with more significant contributions to model prediction changes. Motivated by it, we propose CatchBackdoor, a detection method against trojan attacks. Based on the close connection between trojaned behaviors and trojan path to trigger errors, CatchBackdoor starts from the benign path and gradually approximates the trojan path through differential fuzzing. We then reverse triggers from the trojan path, to trigger errors caused by diverse trojaned attacks. Extensive experiments on MINST, CIFAR-10, and a-ImageNet datasets and 7 models (LeNet, ResNet, and VGG) demonstrate the superiority of CatchBackdoor over the state-of-the-art methods, in terms of (1) \emph{effective} - it shows better detection performance, especially on stealthy attacks ($\sim$ $\times$ 2 on average); (2) \emph{extensible} - it is robust to trigger size and can conduct detection without benign examples.

📄 PDF Abstract BibTeX arXiv:2112.13064

Code (0)

등록된 구현이 없습니다.

Tasks

DNN Testing

Similar Papers 제목 키워드 기반

TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems

2019-08-02 · Wenbo Guo, Lun Wang, Xinyu Xing, Min Du 외

A trojan backdoor is a hidden pattern typically implanted in a deep neural network. It could be activated and thus forces that infected model behaving abnormally only when an input data sample with a particular trigger p…

Anomaly Detection

Dormant Neural Trojans

2022-11-02 · Feisi Fu, Panagiota Kiourti, Wenchao Li

We present a novel methodology for neural network backdoor attacks. Unlike existing training-time attacks where the Trojaned network would respond to the Trojan trigger after training, our approach inserts a Trojan that …

FreeEagle: Detecting Complex Neural Trojans in Data-Free Cases

2023-02-28 · Chong Fu, Xuhong Zhang, Shouling Ji, Ting Wang 외

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particu…

Backdoor Attack

PerD: Perturbation Sensitivity-based Neural Trojan Detection Framework on NLP Applications

2022-08-08 · Diego Garcia-soto, Huili Chen, Farinaz Koushanfar

Deep Neural Networks (DNNs) have been shown to be susceptible to Trojan attacks. Neural Trojan is a type of targeted poisoning attack that embeds the backdoor into the victim and is activated by the trigger in the input …

Sensitivity

PolicyCleanse: Backdoor Detection and Mitigation in Reinforcement Learning

2022-02-08 · Junfeng Guo, Ang Li, Cong Liu

While real-world applications of reinforcement learning are becoming popular, the security and robustness of RL systems are worthy of more attention and exploration. In particular, recent works have revealed that, in a m…

Machine Unlearningreinforcement-learningReinforcement LearningReinforcement Learning (RL)