paper-with-me

Papers

Backdooring Vision-Language Models with Out-Of-Distribution Data

2024-10-02 · Weimin Lyu, Jiachen Yao, Saumya Gupta, Lu Pang, Tao Sun, Lingjie Yi, Lijie Hu, Haibin Ling, Chao Chen

The emergence of Vision-Language Models (VLMs) represents a significant advancement in integrating computer vision with Large Language Models (LLMs) to generate detailed text descriptions from visual inputs. Despite their growing importance, the security of VLMs, particularly against backdoor attacks, is under explored. Moreover, prior works often assume attackers have access to the original training data, which is often unrealistic. In this paper, we address a more practical and challenging scenario where attackers must rely solely on Out-Of-Distribution (OOD) data. We introduce VLOOD (Backdooring Vision-Language Models with Out-of-Distribution Data), a novel approach with two key contributions: (1) demonstrating backdoor attacks on VLMs in complex image-to-text tasks while minimizing degradation of the original semantics under poisoned inputs, and (2) proposing innovative techniques for backdoor injection without requiring any access to the original training data. Our evaluation on image captioning and visual question answering (VQA) tasks confirms the effectiveness of VLOOD, revealing a critical security vulnerability in VLMs and laying the foundation for future research on securing multimodal models against sophisticated threats.

📄 PDF Abstract BibTeX arXiv:2410.01264

Code (0)

등록된 구현이 없습니다.

Tasks

Image CaptioningImage to textQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Similar Papers 제목 키워드 기반

Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignment

2024-11-23 · CVPR 2024 1 · Alvi Md Ishmam, Christopher Thomas

In recent years there has been enormous interest in vision-language models trained using self-supervised objectives. However, the use of large-scale datasets scraped from the web for training also makes these models vuln…

Language ModelingLanguage Modelling

Curse or Redemption? How Data Heterogeneity Affects the Robustness of Federated Learning

2021-02-01 · Syed Zawad, Ahsan Ali, Pin-Yu Chen, Ali Anwar 외

Data heterogeneity has been identified as one of the key features in federated learning but often overlooked in the lens of robustness to adversarial attacks. This paper focuses on characterizing and understanding its im…

Federated Learning

Forgetting to Forget: Attention Sink as A Gateway for Backdooring LLM Unlearning

2025-10-19 · Bingqi Shang, Yiwei Chen, Yihua Zhang, Bingquan Shen 외 arxiv

Large language model (LLM) unlearning is a key approach for removing undesired data, knowledge, or behaviors from pretrained models while retaining their general utility. Yet, with the rise of open-weight LLMs, we ask: c…

Dynamic Backdoor Attacks Against Deep Neural Networks

2021-01-01 · Ahmed Salem, Rui Wen, Michael Backes, Shiqing Ma 외

Current Deep Neural Network (DNN) backdooring attacks rely on adding static triggers (with fixed patterns and locations) on model inputs that are prone to detection. In this paper, we propose the first class of dynamic …

Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning

2026-01-31 · Jianyi Zhou, Yujie Wei, Ruichen Zhen, Bo Zhao 외 arxiv

Vision-Language-Action (VLA) models have become foundational to modern embodied AI systems. By integrating visual perception, language understanding, and action planning, they enable general-purpose task execution across…