paper-with-me

홈 › Papers

RunawayEvil: Jailbreaking the Image-to-Video Generative Models

2025-12-07 · Songping Wang, Rufan Qian, Yueming Lyu, Qinglong Liu, Linzhuang Zou, Jie Qin, Songhua Liu, Caifeng Shan arxiv

Image-to-Video (I2V) generation synthesizes dynamic visual content from image and text inputs, providing significant creative control. However, the security of such multimodal systems, particularly their vulnerability to jailbreak attacks, remains critically underexplored. To bridge this gap, we propose RunawayEvil, the first multimodal jailbreak framework for I2V models with dynamic evolutionary capability. Built on a "Strategy-Tactic-Action" paradigm, our framework exhibits self-amplifying attack through three core components: (1) Strategy-Aware Command Unit that enables the attack to self-evolve its strategies through reinforcement learning-driven strategy customization and LLM-based strategy exploration; (2) Multimodal Tactical Planning Unit that generates coordinated text jailbreak instructions and image tampering guidelines based on the selected strategies; (3) Tactical Action Unit that executes and evaluates the multimodal coordinated attacks. This self-evolving architecture allows the framework to continuously adapt and intensify its attack strategies without human intervention. Extensive experiments demonstrate RunawayEvil achieves state-of-the-art attack success rates on commercial I2V models, such as Open-Sora 2.0 and CogVideoX. Specifically, RunawayEvil outperforms existing methods by 58.5 to 79 percent on COCO2017. This work provides a critical tool for vulnerability analysis of I2V models, thereby laying a foundation for more robust video generation systems.

📄 PDF Abstract BibTeX arXiv:2512.06674

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningVideo Generation

Similar Papers 제목 키워드 기반

Automatic Jailbreaking of the Text-to-Image Generative AI Systems

2024-05-26 · Minseon Kim, Hyomin Lee, Boqing Gong, Huishuai Zhang 외

Recent AI systems have shown extremely powerful performance, even surpassing human performance, on various tasks such as information retrieval, language generation, and image generation based on large language models (LL…

Image GenerationInformation RetrievalMachine UnlearningText Generation

A Systematic Investigation of RL-Jailbreaking in LLMs

2026-05-07 · Montaser Mohammedalamen, Kevin Roice, Reginald McLean, Alyssa Lefaivre Škopac arxiv

The evolution of generative models from next-token predictors to autonomous engines of complex systems necessitates rigorous safety hardening. Adversarial jailbreaking, the strategic manipulation of models to elicit harm…

Reinforcement Learning

VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models

2026-02-24 · Bowen Zheng, Yongli Xiang, Ziming Hong, Zerong Lin 외 arxiv

Image-to-Video (I2V) generation models, which condition video generation on reference images, have shown emerging visual instruction-following capability, allowing certain visual cues in reference images to act as implic…

Video Generation

Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models

2024-08-01 · Yingkai Dong, Xiangtao Meng, Ning Yu, Zheng Li 외

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully craf…

Image GenerationIn-Context LearningLanguage ModellingLarge Language Model+2

Multi-turn Jailbreaking Attack in Multi-Modal Large Language Models

2026-01-08 · Badhan Chandra Das, Md Tasnim Jawad, Joaquin Molto, M. Hadi Amini 외 arxiv

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capabl…