paper-with-me

홈 › Papers

Persistent Backdoor Attacks in Continual Learning

2024-09-20 · Zhen Guo, Abhinav Kumar, Reza Tourani

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been studied in various contexts, little attention has been given to their practicality and persistence in continual learning, particularly in understanding how the continual updates to model parameters, as new data distributions are learned and integrated, impact the effectiveness of these attacks over time. To address this gap, we introduce two persistent backdoor attacks-Blind Task Backdoor and Latent Task Backdoor-each leveraging minimal adversarial influence. Our blind task backdoor subtly alters the loss computation without direct control over the training process, while the latent task backdoor influences only a single task's training, with all other tasks trained benignly. We evaluate these attacks under various configurations, demonstrating their efficacy with static, dynamic, physical, and semantic triggers. Our results show that both attacks consistently achieve high success rates across different continual learning algorithms, while effectively evading state-of-the-art defenses, such as SentiNet and I-BAU.

📄 PDF Abstract BibTeX arXiv:2409.13864

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Persistent Backdoor Attacks under Continual Fine-Tuning of LLMs

2025-12-12 · Jing Cui, Yufei Han, Jianbin Jiao, Junge Zhang arxiv

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driv…

Continual Backdoor Training in IoT/CPS

2026-06-12 · Oxana Salish, Kuniyilh S arxiv

Internet of Things (IoT) and Cyber-physical systems (CPS) increasingly rely on continual learning (CL) to adapt to evolving environments, device heterogeneity, and concept drift, thereby improving overall utility. While …

Continual Learning

Backdoor Attacks on Contrastive Continual Learning for IoT Systems

2026-02-13 · Alfous Tim, Kuniyilh Simi D arxiv

The Internet of Things (IoT) systems increasingly depend on continual learning to adapt to non-stationary environments. These environments can include factors such as sensor drift, changing user behavior, device aging, a…

Representation LearningContinual Learning

Injection, Attack and Erasure: Revocable Backdoor Attacks via Machine Unlearning

2025-10-15 · Baogang Song, Dongdong Zhao, Jianwen Xiang, Qiben Xu 외 arxiv

Backdoor attacks pose a persistent security risk to deep neural networks (DNNs) due to their stealth and durability. While recent research has explored leveraging model unlearning mechanisms to enhance backdoor concealme…

Bilevel Optimization

Look, Listen, and Attack: Backdoor Attacks Against Video Action Recognition

2023-01-03 · Hasan Abed Al Kader Hammoud, Shuming Liu, Mohammed Alkhrashi, Fahad Albalawi 외

Deep neural networks (DNNs) are vulnerable to a class of attacks called "backdoor attacks", which create an association between a backdoor trigger and a target label the attacker is interested in exploiting. A backdoored…

Action RecognitionTemporal Action Localization