paper-with-me

홈 › Papers

Multi-Task Models Adversarial Attacks

2023-05-20 · Lijun Zhang, Xiao Liu, Kaleel Mahmood, Caiwen Ding, Hui Guan

Multi-Task Learning (MTL) involves developing a singular model, known as a multi-task model, to concurrently perform multiple tasks. While the security of single-task models has been thoroughly studied, multi-task models pose several critical security questions, such as 1) their vulnerability to single-task adversarial attacks, 2) the possibility of designing attacks that target multiple tasks, and 3) the impact of task sharing and adversarial training on their resilience to such attacks. This paper addresses these queries through detailed analysis and rigorous experimentation. First, we explore the adaptation of single-task white-box attacks to multi-task models and identify their limitations. We then introduce a novel attack framework, the Gradient Balancing Multi-Task Attack (GB-MTA), which treats attacking a multi-task model as an optimization problem. This problem, based on averaged relative loss change across tasks, is approximated as an integer linear programming problem. Extensive evaluations on MTL benchmarks, NYUv2 and Tiny-Taxonomy, demonstrate GB-MTA's effectiveness against both standard and adversarially trained multi-task models. The results also highlight a trade-off between task accuracy improvement via parameter sharing and increased model vulnerability due to enhanced attack transferability.

📄 PDF Abstract BibTeX arXiv:2305.12066

Code (1)

zhanglijun95/mtlattack-dgba 공식 구현 pytorch

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

Multi-Task Adversarial Attack

2020-11-19 · Pengxin Guo, Yuancheng Xu, Baijiong Lin, Yu Zhang

Deep neural networks have achieved impressive performance in various areas, but they are shown to be vulnerable to adversarial attacks. Previous works on adversarial attacks mainly focused on the single-task setting. How…

Adversarial Attack

Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries

2025-08-10 · Wenqiang Wang, Yan Xiao, Hao Lin, Yangshijie Zhang 외 arxiv

Current multi-task adversarial text attacks rely on abundant access to shared internal features and numerous queries, often limited to a single task type. As a result, these attacks are less effective against practical s…

Text-to-Image GenerationText Classification

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

2024-04-30 · Wanqi Zhou, Shuanghao Bai, Danilo P. Mandic, Qibin Zhao 외

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primaril…

Adversarial DefenseAdversarial RobustnessAdversarial Text

Downlink Power Allocation in Massive MIMO via Deep Learning: Adversarial Attacks and Training

2022-06-14 · B. R. Manoj, Meysam Sadeghi, Erik G. Larsson

The successful emergence of deep learning (DL) in wireless system applications has raised concerns about new security-related challenges. One such security challenge is adversarial attacks. Although there has been much w…

regression

A Multi-task Adversarial Attack Against Face Authentication

2024-08-15 · Hanrui Wang, Shuo Wang, Cunjian Chen, Massimo Tistarelli 외

Deep-learning-based identity management systems, such as face authentication systems, are vulnerable to adversarial attacks. However, existing attacks are typically designed for single-task purposes, which means they are…

Adversarial AttackManagement