paper-with-me

Papers

Blind Backdoors in Deep Learning Models

2020-05-08 · Eugene Bagdasaryan, Vitaly Shmatikov

We investigate a new method for injecting backdoors into machine learning models, based on compromising the loss-value computation in the model-training code. We use it to demonstrate new classes of backdoors strictly more powerful than those in the prior literature: single-pixel and physical backdoors in ImageNet models, backdoors that switch the model to a covert, privacy-violating task, and backdoors that do not require inference-time input modifications. Our attack is blind: the attacker cannot modify the training data, nor observe the execution of his code, nor access the resulting model. The attack code creates poisoned training inputs "on the fly," as the model is training, and uses multi-objective optimization to achieve high accuracy on both the main and backdoor tasks. We show how a blind attack can evade any known defense and propose new ones.

📄 PDF Abstract BibTeX arXiv:2005.03823

Code (1)

ebagdasa/backdoors101 공식 구현 pytorch

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Backdooring Explainable Machine Learning

2022-04-20 · Maximilian Noppel, Lukas Peter, Christian Wressnegger

Explainable machine learning holds great potential for analyzing and understanding learning-based systems. These methods can, however, be manipulated to present unfaithful explanations, giving rise to powerful and stealt…

BIG-bench Machine LearningMalware Classification

Revealing Vulnerabilities of Neural Networks in Parameter Learning and Defense Against Explanation-Aware Backdoors

2024-03-25 · Md Abdul Kadir, GowthamKrishna Addluri, Daniel Sonntag

Explainable Artificial Intelligence (XAI) strategies play a crucial part in increasing the understanding and trustworthiness of neural networks. Nonetheless, these techniques could potentially generate misleading explana…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Backdoor Vulnerabilities in Normally Trained Deep Learning Models

2022-11-29 · Guanhong Tao, Zhenting Wang, Siyuan Cheng, Shiqing Ma 외

We conduct a systematic study of backdoor vulnerabilities in normally trained Deep Learning models. They are as dangerous as backdoors injected by data poisoning because both can be equally exploited. We leverage 20 diff…

Data PoisoningDeep Learning

Interactive Simulations of Backdoors in Neural Networks

2024-05-21 · Peter Bajcsy, Maxime Bros

This work addresses the problem of planting and defending cryptographic-based backdoors in artificial intelligence (AI) models. The motivation comes from our lack of understanding and the implications of using cryptograp…

backdoor defense

Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs

2026-06-02 · Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia 외 arxiv

Backdoor attacks in Large Language Models (LLMs) are a growing security concern, where models can generate adversary-chosen content. Existing defenses target backdoors one at a time and typically require knowledge of the…

Continual Pretraining