paper-with-me

Papers

Cross-Task Attack: A Self-Supervision Generative Framework Based on Attention Shift

2024-07-18 · Qingyuan Zeng, Yunpeng Gong, Min Jiang

Studying adversarial attacks on artificial intelligence (AI) systems helps discover model shortcomings, enabling the construction of a more robust system. Most existing adversarial attack methods only concentrate on single-task single-model or single-task cross-model scenarios, overlooking the multi-task characteristic of artificial intelligence systems. As a result, most of the existing attacks do not pose a practical threat to a comprehensive and collaborative AI system. However, implementing cross-task attacks is highly demanding and challenging due to the difficulty in obtaining the real labels of different tasks for the same picture and harmonizing the loss functions across different tasks. To address this issue, we propose a self-supervised Cross-Task Attack framework (CTA), which utilizes co-attention and anti-attention maps to generate cross-task adversarial perturbation. Specifically, the co-attention map reflects the area to which different visual task models pay attention, while the anti-attention map reflects the area that different visual task models neglect. CTA generates cross-task perturbations by shifting the attention area of samples away from the co-attention map and closer to the anti-attention map. We conduct extensive experiments on multiple vision tasks and the experimental results confirm the effectiveness of the proposed design for adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2407.13700

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Attack

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Self-supervised Learning: Generative or Contrastive

2020-06-15 · Xiao Liu, Fanjin Zhang, Zhenyu Hou, Zhaoyu Wang 외

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alterna…

Graph LearningRepresentation LearningSelf-Supervised LearningSurvey

AnyAttack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Models

2024-10-07 · CVPR 2025 1 · Jiaming Zhang, Junhong Ye, Xingjun Ma, Yige Li 외

Due to their multimodal capabilities, Vision-Language Models (VLMs) have found numerous impactful applications in real-world scenarios. However, recent studies have revealed that VLMs are vulnerable to image-based advers…

Image CaptioningImage-text RetrievalText Retrieval

HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphs

2024-03-31 · Sunwoo Kim, Shinhwan Kang, Fanchen Bu, Soo Yong Lee 외

Hypergraphs are marked by complex topology, expressing higher-order interactions among multiple nodes with hyperedges, and better capturing the topology is essential for effective representation learning. Recent advances…

Hypergraph representationsNode ClassificationRepresentation LearningSelf-Supervised Learning

Generative Adversarial Patches for Physical Attacks on Cross-Modal Pedestrian Re-Identification

2024-10-26 · Yue Su, Hao Li, Maoguo Gong

Visible-infrared pedestrian Re-identification (VI-ReID) aims to match pedestrian images captured by infrared cameras and visible cameras. However, VI-ReID, like other traditional cross-modal image matching tasks, poses s…

Adversarial Attack

Evidence-Consistent Generative Detection under Scenario-Level Distribution Shift

2026-08-21 · San Kim, JinYeong Bak arxiv

Conventional in-distribution evaluation can overestimate robustness when training and test data share recurring task-specific patterns or surface cues. This risk is especially relevant in social-engineering fraud detecti…

Fraud Detection